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CHAPTER ONE 



INTRODUCTION 



Child growth and development can'te influenced 
not .only by educational programs which focus explicitly 
on the child, but also by broader ecoaaomic and social 
efforts which impact on the larger family uilit. Programs 
such as income maintenance, employment, and housing 
which can directly alter the environment or affect the 
resources available to parents and families can also, 
through these changes, significantly affect the- child* 
Little attention has been given, however, ta^assessing 
the implications of these broader programs for child 
development. Typically, only "jchild development" efforts 
have^been evaluated in terms of their impact on children. 
Different poverty programs are, however, far from inde- 
pendent, and there is a need^ f or assessing the ways in 
.which differently focused programs serve to meet similar 
goals. . ' 



This study is designed to investigate the effects 
op child development of housing location change. There 
are many reasons to expect that housing programs which 
permit location change will have important and benefi- 
cial implications for child development. Location change 
may be expected to be beneficial to the family and thus 
the child by allowing escape from oppressive environmental 
conditions, and by permitting access to conditions that 
are more favorable. Many aspects o£ the inner city 
environment— poverty, crime, drugs, poor municipal 
services and public facilities, lack of educational oppor- 
tunity, etc. — make it difficult for individuals forced 
to live there to achieve desired goals for themselves 
and their children. Fragmentary support pro'gra^jis which 
aim at altering one aspect of such f lilies' lives* have 
generally^ not been found to yield significant long 
term changes in child development, possibLy^lbecause they 
leave the major portion of a debilitating environment 
unmodified. It is reasonable to hypothesi^6, ^owever, 
that programs which lead to more •fundamen1:al environmental 
changes, programs which make it possible for interested 



families to move to areas with more favorably charactei^- 
istics--improve<^^* pUysicalV social, and eduoatj.ona]^*envir- 
' onmerits— will have iiftportant*and . long -lasting effects on 
* the development of the family and the cR;i~l'd"^^ ' 

The purpose of this report is to present and justify 
a rese|:t6h design for, the inves^'tigation of the relation- 
ship between the 'housing environment "oh the one hand, 
and a range of child development and family measure? on 
the other. The 'necoimnehd^^ design is non-experimental 
in nature" and focuses upon comparisons of residents 
in selected housing program^s; housing programs are here 
defined as publicly supported residential housing complexes 
Because of the non-experimental. nature of^the proposed 
design, the danger of self-selection bias in inter- 
program comparisons is quite severe, and consiaerable 
emphasis has been given to the resolution of this 
problem in the development of the proposed research design. 
This emphasis findls expression in the sequential nature 
of the design proposed and in the introduction of tests 
for self-selection at each phase, A computer simulation 
. of the entire investigation has been conducted using a 
variety of assumptions v?ith respect to th^ existence and 
nature of self-selection, and the results of this simula- 
tion have been used to calculate optimal decision rules 
for the conduct of the study. 



The choice of a non-experimental approach to this 
investigation was not made withoiit a thorough considera- 
tion of its relative advantages and disadvantages. The 
basic problems of inference which are associated with 
investigation of the interaction of ihuman subjects with 
their environment are reviewed in the context of the 
independent variables of interest in Chapter Two of this 
report. Chapters Three and Four deal with non-experimental 
and experimental approaches respectively, with major 
emphasis being given to the desprip'tion and documenta- 
tion of the recommended i>onTexperimental approaqh. The 
final chapter presents recommended instruments for the 
measuriement of the cognitive, socio-emotional , and 
physical development in subject children, together with 
supplementary measures of /family well-being, ..Lastly, 
three appendices provide descriptions of the recommended 
measurement instruments and documentation of the simulaticm 
study, , < . 



CHAPTER TWO 
PROBLEMS OF INFERENCE IN THE INVESTIGATION 
OF ENVIRONMENTAL CHANGE 



The basic objectives of this study relate to a 
conjectured causal relationship between^ on the one hand, 
the environment of home and neighborhood in which a 
child grows up and, on the other, his ability to learn 
and to stay healthy. Realization of these objectives is 
unlikely if the associated problems of inference are not 
carefully and systematically examined. 



Statement of the hypotheses under investigation 
requires identification of the dependent variables which 
characterize child development and of the independent 
variables which characterize the child's environment. 
Statement of the hypotheses also requires the identifi- 
cation of the subjisct population for whom the hypotheses 
'ate expected to hold./ Other things being equal, it i^ 
desirable that the subject population should be as * 
inclusive as. possible, thus investigation of the impact 
of the housing environment on the development of the child- 
frbm families of all income groups, racial backgrounds, 
and current housing types will, in general, bq. more useful 
than an investigation of only a subset of the population.. 
Unfortunately, there i? frequently a conflicft between a 
desirQ to make the investigation as inclusive as possible 
and the necessity to isolate causal, rather than statistical 
associations between variables. ' ' . 



In order to identify -causal relationships between 
variables, it is necessary to design experiments so 'that 
the levels of selected factors -can be varied while all 
other factors are held constant. In the ideal experiment, 
all the factors likely to affect child development 
variables qan be controlled and independently manipulated. 
Subjects can be independently sampled and randomly assigned 
to planned combinations of conditions . In such an 
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exeejriment the effects or impact 'of-a-program can-be^ - 

partitioned into additive component effects attributable 

to the separate factors or combinations of factors. ^ 

^ Hypotheses of the form "if A then B" can then be speci- 

"fiCBlly tested. Unfortunately, "it is never possible 
to know all the" pertinent variables that influence an 
outcome, nor can they always be^ controlled even if they 
are known. Randomization helps here by counter-balancing 
the biases that the unknown factors introduce. Since' 
^ each member in. the population has equal opportunity of 

being selected by random sampling, members with certain 
distinguishing characterist;ics will be balanced, in the 
long run, by members with opposite characteristics. 



To meet the requirements of such an ideal experiment. 
It must be possible both to control the variables which 
characterizie the housing treatments and' also to assign 
.families at random to alternative treatments, 'in the 
• context of this design, and indeed -of most social science- 
designs, neither of these conditions can be assumed. * 
In the first place, cpntrol over the variables which 
characterize the , housing treatments is limited by whal; 
is available in the real world—and the real world does 
not provide planned combinations of conditions. Secondly, 
it is generally necessary to work with "subjects who have 
assigned themselv^ to treal!ments, and no ma,tter how 
skillfully "matching" or covariance 'adjustments are 
carried out, the basic problem of post factum research 
remains: groups can be matched on a hundred variables 
and still differ on one which is relevant to the level 
of child development. , 



In developing the designs presented in this section, 
consideration has been given to genuine experimental 
settings in which families are randomly assigned to 
alternative treatments and in which planned combinations- 
of housing characteristics are developed. The methodo- 
logical advantages of, these alternatives are only achieved 
at great expense, however, and ordinary prudence sug5ests" 
that .they should not be undertaken without first conducting 
a careful and well-de&igned analysis of the data which the 
world alrea[dy provides. The emphasis of this work has, 
therefore, been on the development of sampling designs 
which overcome, to the greatest extent possible, the limi- ' 
i:ations of -the post factum experiment. 

^ 4 - 
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2.1 Problems of Self-Selection in the Desigrr 



In reviewing the general problems of post faction * • 
experiments, emphasis has been placed on .the problems^ 
of inffererfce caused by the self-assignment of individuals 
to different housing treatments. In contrasting the 
independent (phild development)' variables across different 
treatments, X::t'-is difficult to'fce sure whether the 
observed var^iation is caused i>y the variation in treat- 
ments* of by differences in the populations which have 
assigned themselves to these treatments. It would, for 
example:, be clearly absurd to contrast the achievement 
levels of different housing groups in a random sample 
of all families in the U.S. and thereby infer a causal 
relationship between housing *and child development, 
although a highly significant association would undoubtedly 
exist. * ♦ 



Two kinds of self-selection hias may be present in 
the investigation of ^ the relationship between housing 
and child deveiopitjent • The first of these is the bias 
introduced when the entering gppulations of different 
housing programs aire not comparable with respect to the 
variables which influence child development. , Less obvious 
is the bias .which results from differences in the charac- 
'teristics of families exiting the program; if , mobility* 
is correlated, either positively or negatively With 
dependent variables,., comparisons^ between resi^d^'nt and 
control groups will tend either to^ under- or over-estimate 
effects; this is still further complicated when mobility 
itself varies between treatments* 

' * i . 

Attempts to 'minimize the self--assignment of self- 
selection problem must necessarily focus on insuring 
that the populations assigned to different treatments 
are, as/far as is possible, .comparable in all dimensions 
relevant^ 'tp^ ph4- Id development. . At a minimvun--and most 
designs ^t^p .at a minimum — this requires that the 'treat- 
ment groups be matched on socio-.economic and family 
variable?; thus, for example, it* may b6 ne^cessary to qubta, 
sample* vi thin the treatment populations, to insure 




comparability of groups with respect to income ^ ethnic mix, 
family size^ family structure^ and sex of child. This^ by 
itself f does not provide adequate protection against pro- 
blrems of self-selection, for one critical difference 
between the treatment groups remains: their choice of 
treatment. Nor is this simply a theoretical objection. 
To the extent that certain housing and school environments 
are conducive to healthy child development, .parental/ 
attitudes and meth6ds of child-rearing^ may well be associa- 
ted with particular housing preference patterns. We 
cannot, therefore, infer that observed differences between 
the children of matched families living in suburban neigh- 
borhoods and in dilapidated inner-city housing are attri- 
butable to the housing/neighborhood change alone, for if 
the inner-city children were to be reassigned to the^ 
suburban homes, and the suburban children were to be 
reassigned to the inner-city homes, they would take with 
them parents who had made a fundamentally different choice 
about the way they should lead their lives. 

There is an obvious conflict between the logic of 
this argumfejit "^nd the basic requirements of statistical 
inference. To achieve comparability amongst treatment 
groups, it is necessary to insure that their housing choices 
are similar; to estimate the impact of different treatments 
it is necessary to insure that housing choices are differ- 
ent. The conflict is similar where mobility leads to 
inter-temporal self-selection; to' avoid bias, comparison 
groups should have similar lengths of residence; to 
permit contrasts, their lengths of residence should be 
different. 



It#is cle^arly necessary to effect a compromise "- 
between the need for variation in treatments an.d the need 
for homogeneity amongst treatment groups . / Efforts to 
achieve such a coitlpromise are reflected in the 'designs 
proposed. There are. two complementary ways to approach 
the problem: in the first place the choices of treatments, 
should be carried out in such a way as to provide reason- 
able Assurance that the entering populations will be 
comparable. In the designs proposed this is achieved 
through an exclusive emphasis on subsidized housing 
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programs. This* provides some assurance that treatment 
groups are comparable in the sense /^at they are all { 
• families for^vrfiom subsidized housing is an acceptable •', 
alternative. * . * * . , 

The second approach to the probleirt^of self-selection 
tias is to test for it;s presence. In -the. designs \ ' 
developfedy tests for the homqgeneity of both entering and 
exiting populations are included. If thesj^ tests are 
passed, the 'findings of the investigation- would be ,extremely 
hard to refute. • •/ 

» " , ^ ' ♦ 

In reviewing the treatment of self-selection 
problems in the designs proposed, it is ..fair to say tljat 
tl>e attempt to solve these problems has'^-^'exercised a 
profound influence on the choices" made. The early 
thinking about these designs included work on methods ^ 
of analysis which would' allocate developmental gains 
between successive housing environments and which would 
require the tracing of families moving through both 
private and public housing markets. Apart from; other 
questions of feasibility, this approach could not be 
^^.^..^j^ -g^^^ 2^^^^ with the theoreticail objections reviewed ^ 

above, is fair to acknowledge that by concentrating 

on res^idents of publicly supported housing programs, a 
number of interesting hypotheses can no ^longer be inves- 
tigated. Nevertfieless, the hypotheses which remain are 
of vital interest to those concerned with the role of. 
the government in the sponsorship of good housing. 



2.2.1 Independent Environmental Variables. 



In the non-experimental setting of these designs, 
the variables that rcharacterize a housing pi^ogram cannot 
be directly controlled or manipulated. The selection of. 
independent variables in this design is therefore deter- 
mined by the decision to include or to exclude existing 
or planned public h9using programs, and these decisions 
are, in turn, constrained by what is available. Within 
these constraints, it is possible to emphasize selected 
dimensions of variation in program characteristics and 
the "choice of emphasis must necessarily reflect the nature 
of the hypotheses under investigation. The principal 
emphasis of the designs proposed is .upon the socio- 
economic dimensions of relocation rather than upon^ its 
physical and spatial-aspects. This emphasis reflects 
the view that social and economic change is a potentially 
more powerful influence on the development of children 
than is improvement in the* physical and spatial aspects 
of home and neighborhood. 



Alternative approaches to the measurement of socio- 
economic change can be contrasted in terms of the decision 
to use a composite or non-composite measure and in terms" 
of tl;ie choice of variable's. Composite measures lump 
together siBveral variables such as household income, 
occupational distribution, educational achievement, and 
SO' on, to form an index of th^ .sbcib-ecohpmic status of 
a selected, population. The difficulties associated with 
comprehensive measures of this kind are generally the 
availability of data, the non-operational nature of the 
measure and the arbitrary element associated with choice 
of the index weighting scheme. These difficulties all 
point in the direction of a simple measure of socio-^ 
economic * change if there is one available which is highly 
correlated with omitted measures in the populations of 
interest*; Household income is the obvious candidate in 
this application, being highly correlated with other 
measures of socio-economic status, such.^^j occupational , 



breakdown and educational achievement. Since household 
income data is available from the 1970 Census at a ' ^ 
relatively fine level of spatial disaggregation, .its ^use 
as the characterizing variable seems highly desirable. 

In chatracterizing environmental change in terms of: 
its socio-economic dimensions r a distinction can be made 
between the program itself, the neighborhood in which 
it is located and the school in which its children are 
enrolled. All three can, in principle, exhibit indepen- 
dent variation with respect to the socio-economic mix qf^ 
their members, but the real wo^rld with its lirait^ ifange 
of combinations may not provide an adequate base for - ^ 
investigation of the separate contributions. of each^ 
In particular there will tend to be a high degree of 
collinearity between the socio-economic status of the 
neighborhood and of the school populations; indeed if 
the neighborhood is defined as coterminous with the 
school district, there is an effective problem of singu-* 
larity. These considerationsr—as well as considerations 
of cost and feasibility — lead to the elimination of • either 
school or neighborhood as an independent source of 
varicition. 



Two dimensions of environmental change remain: the 
neighborhood and the pr6gram itself. These together 
determine the income mix of the program child.* s peer 
group. The difficulty here is not to define variables 
which characterize neighborhood and program SES,. but to 
find programs which provide adequate independent varia- 
tion along both of these^ dimensions, rfi the real world, 
the income balance of^i^rogram and neighborhood are heavily 
confounded with very few low-income programs in high- 
income neighborhoods, and still more elusive, moderate- 
income programs in low-income areas. Only throtigh a 
comprehensive search of programs has it been possible to 
complete the designs' presented here. 
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V ' 4 Independent Family and Child Variables 



The primary hy^fotheses of this investigation relate 
-to the effects of socio-reconomic integration on the ,devel- 
opmient of children in subsidised housing^ programs; 
dmplicit in this hypothesis is the assumption that differ- 
ences between .the socio-economic status of the subject 
^nd that of his neighbors may affect the subject's rate 
of development. . It follows, therefore, that those family 
and child variables which are associs(ted with cultural C 
or economic deprivation in urban communities should be 
-treated a's independent variables in this analysis. 

There are, in ^addition, characteristics of the family 
and the child which, . although they may be influential in 
terms of child development, do not interact directly with, 
the socio-economic variables used to characterize envir- 
oninental change. Variables ?uch as family size, family 
structure, and sex of child must therefore J£>b experimen- 
tally contiroiled in the sense that,iEthe samples must be 
balanced across treatment combinations — but they need not 
be subject to special investigation. These, ^together with 
those variables which must be statistically controlled, 
such as age of respondent constitute the set. of "nuisance 
variables!' in the designs wlixch follow. 

The requirement that samples be balanced across 
programs with respect Jto both the independent variables 
and the experimentally controlled nuisance variables 
constitutes quite a severe constrai^nt on the selection of • 
housing programs, since it must be possible to find'applrb- 
priately balanced samples in all the programs.:' 
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'■ ' , CHAPTER THREE 
NON-EXPERIMENTAL DESIGNS FOR HOUSING PROGRAM IMPACT 

* . * ' • 

The principal emphasis of the design effort has 
been upon the development of jipn-exRerimental approaches 
to the investigation^ of child-development/hbusing inter- 
action. The difficulties of the non-experimental 
approach, and in. particular those relating to ^elf- 
selection bias, have already been discussed; the emphasis 
on' non-experimental designs dpes not, therefore, 
reflect any lack, of appreciation of the extent and 
nature of the associated problems of inference. 



The emphasis on non-experimental approaches dpes, 
however, represent a judgment with respect , to the compar- 
ative cost-ef |ectiveness of experimental arid non- 
experimental approaches. Experimental approaches ar6 
characteristically, costly and difficult to administer— 
and housing experiments ar^ no exception to this rule. 
Commitments to families participating in any housing 
experiment cannot be transient^ and the costs of data * 
collection and analysis, which represent the complete 
expense for the non-experimental approach, characteris- 
tically represent only a small part of the total costs 
of a truly experimental design./ If there were no 
conceptually adequate non-experimental approach available, 
the'' cost difference .would not, in itself, be sufficient 
reason for rejecting" the ^experimental* design^ If there 
are grounds for believing tl^at a conceptually adequate 
non-experimental approach exists, however, it is extremely 
hard to justify , a more elaborate -expensive recommendation. 

The choice between non-experimental and ex:perimental 
approaches is not the only question of strategy. Within 
the. non- experimental approach itself ,. there are a. set of 
al€erna.tive. methods for collecting and analyzing data; 
and the choice among these strattegies depends uppn prior 
judgments as ''to the validity of the hypotheses themselves 
and the reliability of the methods by which they are to 
be investigated. These issues and their relationship tq^ 
the manner in which the non-experimental approach is t 
implemented, are now reviewed in detail. 



3,1 Strategies for the Non-Experimental Investigation 

In reviewing the strategies for. a major non- 
experimental investigation of housing/child development 
interaction, it is useful to distinguish between all 
the logically possible outcomes. These outcomes pan 
be summarized in terms of change in the dependent varia- 
bles, the influence of the indeperideni: variables, and the 
validity of the assumptions^ underlying the design, 

• ■ • ; , . 'H>. 

It is useful to begin Ijy considering a very general 
type of design in which there are several child develop- 
ment — or outcomer— variables on which measurements are 
made. These measurements are made on children in programs 
which differ with respect to the independent variables 
of interest. In analyzing the variation in the dependent 
measures between programs there are two mutually exclu- 
sive and collectively exhaustive possibilities; 

(1) Significant variation between programs, on at 
least some outcome measures 

(2) No significant variation between programs on 
any outcome measure. 



In the last instance, since there are no detectable 
differences between programs along any dimension of 
child development, efforts to explain it through contrived 
variation in program variables are clearly doomed. In 
the second case, hindsight might suggest that some of the 
outcome measures should not be investigated; to the extent 
that it is possible to extend the investigation of- those 
measures which show significant variation between programs 
at the expense of those which do not, this is clearly 
desirable. 



It has already been pointed out that if.no signifi- 
cant variation between programs is found on any outcome 
measure, investigation of the independent variables is 
not a useful exeafcise. If significant variation in some 
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*or all outcome measures does exist, however, it does 
not follow that this variation will necessarily be 
associated with the planned variation in the selected 
program variables. The programs included in the design . 
will vary amongst each other, not only with respect 
to the independent variables selected for investigation, 
but also with respect to others which cannot be completely 
controlled experimentally. It is, therefore, conceivable 
that the observed variation in* outcome measxures cannot 
be effectively explained by reference to the independent 
variables selected for analysis. Even when the included < 
variables do appear to "explain" much of the observed 
variation, this may simply reflect correlation between 
included. variables and the excluded variables (suppor- 
tive services, tenant management, etc.) which are the 
principal^; sources of variation. This aspect will be 
discussed in the context of the implicit assumptions 
of the design. The set of logical possibilities relating 
to investigation of the influence of selected independent 
variables are: 

(1) Selected independent variables "explain" 
• variation . . 

(2) Selected independent variables fail to * ^ 
"explain" variation 

As already discussed, the validity of results 
obtained through a non-experimental study depends upon 
the elimination of self-selection and upon the exper- 
imental matching of programs upon those excluded program 
variables which may affect child development. There can 
never be any complete assurance that all the relevant 
program variables are adequately treated, but there 
are methods of testing for the presence of self -selection. 
In either event, the detection of significant variation 
in ojatcome measures between programs and the "explana- 
tion" of a Significant part of. this variation by means 
of the selected independent Varia*bles will be valueless 
and misleading if the premises on which, causal inference 
is based cannot be justified. / . 
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These considerations have led to the recommendation 
that the study be conducted in three distinguishable 
phases; the scope and objectives of each of these phases 
can be summarized as follows: 

Phase I , The Phase I study is essentially a 
pilot study involving, a comparison of measured child 
development in two program classifications, differing 
with respect to the level of both environmental variables 
The objectives of the pilot include: test of signifi- 
cant differences between programs, test of homogeneity of 
subjects between programs and screening of outcome 
measures. • 

Phase II . The Phase II study involves data collec- 
tion and analysis in additional program classifications. 
The data will be collected in one wave and analyzed 
jointly with the Phase I data. The objectives of this 
phase are to test the explanatory power of the indepen- 
dent program variables, to test for homogeneitj^^ of 
subjects between programs and to analyze possilDly 
^tended outcome measures. 

Phase III . The Phase III study uses the data from 
Phases I and' II together with data from the same programs^ 
collected in a single subsequent wave. The data from 
these two waves are then analyzed longitudinally. The 
Phase III. effort is similar in its objectives to Phase II 
but, being- longitudinal, it endows the tests with much 
greater power of discrimination. It also provides an 
opportunity to test for inter- temporal self -^select! on 
resulting from mobility in the subject population.* 

j> 

It is useful to regard these three phases as . 
steps in a sequential sampling and decision-making 
exercise. The data collected at. each phase are used to 
determine whether or not to continue the investigation, 
and, if the answer is affirmative, these data are then 
reanalyzed in the framework of the next stage. Since 
nothing is thrown away, the sequential conduct of the 
investigation, jioes- not lead to any significant increase 
in cost even if all three phases are implemented; 



The^ sequential conduct of the investigation, is of 
no .value unless rules are developed^ in .advance, which 
tell the investigator under what conditions the experi- 
ment should be continued. These rules cailnot be based 
on conventional 5%. or 10%. levels of significance because 
such rules ate arbitrary and beaj;;^no relationship to 
the objectives of the study ."^Thus in the first phase , 
for example, several of the programs are quite new and 
the maximum length of residence is in some instances 
less th^n two. years; under these circiamstances it is 
not reasonable to expect the data, to reflect very large 
gains in measured child development; yet use of a 
significance test for effects at the 5% level might 
lead to rejection of the (true) hypothesis that effects 
exist over 50% of the time. 



To deal with this J)rbblem, a computer simulation 
of the investigation through all three phases has been 
developed. This simulation, which is described in 
section 3.6, has permit^d the development of decision 
rules (i.e., critical values of test statistics) by 
attaching payoffs to outcomes such as finding an effect 
when one exists and finding an effect when no effect 
exists. These rules form an integral part of the three 
phase design. ' \ 



3*2 Selection ^of Sample' Populat:iohs • 

o ■ 

, The three phases of the non^experimental study can 
be- distinguished from each other in;, terms of their^ 
inclusion of programs (Phase I vs* Phases II and III) ^. 
All phases share a common requirement that ^ the sample 
populations be compara^^ apross programs^ in the sense & 
that observed variations in ^jphild development are properly 
attributable to the differences between programs rather 
than to the differences between the characteristics of 
the children and families sampled. The methods by which 
sample populations are to be selected to meet — or 
attempt to meet — this requirement are now reviewed, 

if 

The first consideration relates to the need to 
control for age amongst the population of subject children 
Because it is reasonable to hypothesize that t^e envir- 
onmental effects of relocation will differ according 
'^to the develppmental stage of the child, it was considered 
dl^irable to separ^ate subjects into" three groups based 
on the age of the child. - These groups are defined ill - 
terms of. age. range at the time of first testing; they 
aife pteschooi (0r4) ^ elementary school (5-12) , and high 
school (13-17). These age raffiges were Selected with a 
view to reducing variability in scores attributable to 
the emotional transitions of latency/aji^' puberty. 



It is useful to distingidi^hr for' the temainder of 
thi9 sectipn, l^etween independent "and nuisance variables; 
With:^ respect to the independent family variables— 5ES, ^ • 
race and program residence — the;desi*gn itself will require 
that the populations sampled in 'each program can be 
broken down into specif ied ^proportions of families 
belonging to each of ^ these ' grJ6ups^.^' ^Subject to the 
constraints which the -treatment of. the independent 
variables imposes, the subjects must then be chosen to 
ensure comparability along other, objective dimensions, 
such a3 family structure^ sex> and size of family r 
these are the so-cailed -nuisance variables. The 'impor- 
tance of the distinction between 'independent and nuisance 
variables ..for this discussion, is that tHe composition 



^ot- tlie'^ample^with respect to the independent variables 
is f;ixed by the design, while its composition with* respect 
to the nuisance variables may be anything — as long as 
it is tl^e same for each configuration of the independent 
(program and family) variables. With this distinction 
in mind, the procedures for selecting the sample popula- 
tions are now reviewed. ' ' 



3.2.1 Sample Selection — Independent Variables 

.m There are , three basic independent classifications^ 
o,f the sample population within each program. Those . 
classifications are: family SES, race of family and 
prqgram residence. Each is now reviewed in turn. \, 

Faiqily Income ' * 

The conjectured benefits to children^ which result ' 
from movement into an enriche'd environment are, at 
least in part, assumed to result from increased contact 
with peers, both in and out of school, who* have had the 
benefits of higher social and economic status conferred 
on them. In order to examine this effect, the sample 
population ijiust be made to include hdusing program 
families of both low and moderate income. - It is desirable 
and it also appears .to be feasible, to sample, low ^nd 
moderate' income families in ^ equal proportions witliin 



While it is true that from a statistical viewpoint, 
it is only necessary to control for the nuisahce variables 
somehow, the manner in whicK it is done affects the 
interpretation of the results. Thus, if only lairge, one- 
parent families are included,, the results are only ganer- 
alizable to other large, one-parent families.. These 
considerations suggest the need to insure that the families, 
included are reasonable representatives of the population 
of interest. 
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the selected programs. Tor the purppses'of defining 
these categories, it is important to maintain a consis- 
tency across programs, not provided by local eligibility 
criteria. Accordingly, selection of low and moderate 
income definitions will reflect the need to insure 
adequacy of sample sizes in each program classification 
and the^need to ac^just categories to reflect regional 
cost-of-livi'n'g va-riations^ 

Race of Family 

In comparing programs* with signif i'cantly different 
racial compositions, it is reasonable to suppose that 
the impact of these programs will vary according to 
the race of the family sampled. Thus, the advantages 
of the economic int^egration achieved through program 
participation, may be^inhibited if\ they are masked by 
racial discrimination in the. neighborhood or in the 
schqols. * Other things being equal, i^ is* clearly desirable 
to achieve as detailed an ethnic breakdown as_ possible, 
but the extent to which this can ^be done is limited by 
^the availab^ility of programs. For this reason,- only 
white and black families will be iflcluded, and it is 
rec0mmended that the subject, populations be equally 
divided between the two. " * ; . 

P r og r am^fie s i de nc e , ' ' . 1 - / 

!0n each of the selected sites, samples will, be • 
drawn from families who are program residents and from 
families who have applied for residence, but who are 
not yet residei?^ts. The appi45ant families serve two 
purposes in this design; fixshl^, by comparing residents 
wit\i applicants it is pos^sible to test for the effects 
of program residence on families ^nd children; secondly, 
by comparing applicant groups across sites, it is possible 
to test for the existence of ^elf -selection bias. Both 
these- purposes require that the applicant group . on each 
site should resemble th^ resident group pn that site at 
its times of entry. Systematic variation in the dligi- 
bility requirements for. a selected program is therefore 
undesirable. . u 
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The effects of environmental' change, if they. exist> 
nO'doubt take place gradually; other things being eqiial, 
therefore, the longer the "treatment/' the greater will 
be the effects. To avoid confounding the influence of 
length of residence with the independent program a^d 
neighborhood variables, it is therefore necessary to 
control for length of residence in the resident samples. 
This can be achieved most effectively by attempting to 
insure experimental balance between samples drawn from 
different programs; it is ^Iso desirable to introduce a 
lower limit on length of .residence in order to allow some 
opportunity for differentiating residents from non- 
residents. Since all of theseleeted programs are less' 
than two years old at the time. of this report, a lower ' 
limit of eighteen months appears to be a reasonable 
compromise between feasibility and longer residence. 



3.2.2 Sample Selection— Nuisance Variables ^; 

\ . Within each of the independent variable sub- 
classifications, it* is necessary to insure that the 
populations are comparable with respect to the so- 
called nuisance variables; failure to insure balanced 
sramples with respect to these variables may lead t;o 
spurious significance in both program and family variables 

This design calls for the experimenta'l control of 
four nuisance variables. These are: family structur^e, 
family size, sex of child, and previous residence. ^ 

Fan?to^tot^re , . ' ^ 

. This is the euphemism^f6r..^wliether or not there aie 
two parents in tjhe ^^family .^ Some of... the prog^ains ' under 
consideration haye significantly more on^-.J^arent families 
than tworp^arent nfamil^es, and the problem will be to * 
select a ratio between one-parent and two-parent families 
which is feasible for all programs. Inspection «of the 
hotasing program data suggests than up to 20% t)f those 
selected should come from one-parent fami^lies. 
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Family* Size " ' 

It is necessary to controffor family size in' th,e 
selection of samples. This is most coriveniently done 
-V by . considering 'two categories: families with fewer 
than three children and families with three ^pr more, 
children. Even though thefre nvay be some birthrorder 
effects within these cate^Qrj^s, they should not be 
large. 

Sex of Child 



It is probably adequate to omit sex as a nuisance 
variable entirely and simply to trust randomization to ^ 
insure balance between groups. As an additional caution, 
a check can be run on the proportions of male and female 
children in the population. 

Previous Residence 



If the hypotheses of environmental change are true, 
it is essential that, .families be experimentally controlled 
with respe.ct to previous residence for tjie resident group 
and current residence for the applicant .grdup.. The way 
in which they are controlled must necessarily reflect 
the Ipasic emphasis of this study, which is upon significant 
envirotunental ^change. For these reasons, only families 
from low income neighboriioods will be included; since » 
previous residence will be highly correlated with family 
SES, elimination of families from the sample on this 
criterion will probably only affect the moderate income 
families to any great degree. If it proves impossible 
to |j.nd adequate samples of moderate income families 
satisfying the inner-city previous residence constraint, 
*s|t^.this constraint may have, to be relaxed. This would have 
1^ the ^effect of confounding family income and previous 
""residence varijables. 
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•3^.2.3* Sample Selection— Procedures 



Selection of sainaples to meet the criteria stated, 
above will be conducted on the basis . of the par:ent 
interview data,*^ It would be. disingenuous to assume 
that no difficulties will be experienced in meeting the 
fairly stringent Requirements which the sample 'selection 
criteria impose/ ^d it is recognized that some changes 
in the irecommended ratios within each category may be 
necessary after inspection of parent interview data. 
It may be useful^ however, to review a woifked out,, 
but hypothetical example of selection within a given 
program. . . 

* * 

In this program it is assumed that therq are 7'5 
children, all similar with respect to previous residence. 
These are distributed between categories as shown in 
Table 1. ^ By selecting samples from each cell qf sizes 
shown inljbhe bottom right-hand corner of the" cell, it 
is possible to get a well-balanced sample* of 32 children 
within this age group* . ^ 

In this example, there is some limiting confounding 
of the independent and nuisance variables, but it is . ' 
effectively negligible as can* be seen from Table 2. 



1 ' *^ ' ' . ' 

See Parent Interview (Part I), Screeniri^, 
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Table 1 

Hypothetical Eocample- of Selection 
Within a Given-Program 





Income •' 


Race 


Resident 


Mod. 


Lpw 


Blaclc 


White 


Yes 


No 


Fcumily 
struct 
ture 


M par. 


7 


9 


9 


7 


6 


10 


2 par. 


9 


7 • 


, 7 


a9 


10 


6 . 


Family 
size 


Small 


9 


7 


8 


8 


, 7 . 




Large 


7 


•9 


8 


8 


'9 


7 



Table 2 



Distributions of Hyppthejtical Sample 
Observations by .Selected Independent Variables 
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3.3' Non-Experimental Design — P hase - 1 ''(Pilot) 

/ - ' — ■ 

/ 31.3.1 Obj.ectives of the Pilot Study . * . 

Vc ' / * ' ■ ^ 

The pilot study is designed to achieve two principal 
objectives*. These are: 

• (1) A test for thie^ comparability of subject/ - 
\ ^ populations ^ ' 

(2) A test for the existence of effects. 

^ ' ■? 

''a 

The simulation results demonstrate that both the 
test for comparability (absence of self-selection bias) 
and the test for effects should be quite .weak. During 
this phase, .thjLs corresponds witti intuition; since 

. subsequent pha^,es of the design /nave greater power of 
discrimination, it is only desirable to stop the inves-;^ 
tigation at this stage if the probability of subsequent 

'findings is very low. IJevertheless, even with relatively 
weak tests, there , appears to 'be a significant chance of 
terminating at the end of • the pilot'' study 

. In addition, several secondary objectives will be 
realized in the pilot study. These include analysis of 
the influence of, independent family variables, screening 
of outcome measures, procedural improvements, estimates 
of test variances for use in later sample size selection, 
and the detection of pr6blemi% not anticipated in this 
design. - * . • 



The objectives of the pilot study are pio.st effectively, 
realized by contrasting programs which are polar extremes 
in tetmis of the independent program variables*. Thus, it' 
is desirable to contrast programs which are. located in 

' ^See Table 13.. .Simulation Results/ 
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high income neighborhoods and which have a high propor- 
tion of mp^l^^te income residents with low-income programs 
in low-income neighborhoods, . At the same time, it is C 
desir.able that these programs be as well matched as is 
E)gssible on the excluded prograjrt variables — or there is 
J\6 assurance that the variations are attributable to the 
kinds of environmental change on which the investigation 
is focussed. Specific recommendations for Phase I program 
selection are given in Volume II, Housing Program Survey. 



3,3,3 Design and Analysis in Phase I 



The pilot design permits the investigation of program 
group differences, the influence of the independent " 
family variables and a check on the extent of self- 
selection between programs. It is useful to review these 
components of the investigation first of all in terms of 
the analysis of variance, although other techniques of 
analysis will also be employed, * • 

Analysis of Variance 

The pilot design is essentially a .2^ factorial 
delsign, The four 2-way classifications are: program 
residence, family income, race of family, and program 
group; groups will be referred to as Group 1 (High/Moderate 
Neighborhood SES, Moderate Program' SES) and Group 2 i 
(Low Neighborhood SES, Low Program SES), Data* from , 
individual programs are pooled within groups. The cells 
in the pilot design Shown in Table 2 are occupied by 
measured levels of development of children within that 
category, ^ Table 3 can be interpreted as the design for 
a single measure on children of one age grouping. 

Although the pilot study can be laid out as a 2^ 
factorial design, it will be principally analyzed in 
three dimensions. The elimination of dimensions is dic- 
tated tjy' the particular hypotheses of interest,. They 
are now dealt with in turn. 
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Yes ■ 
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Group II 




• 






















































Family 
Income 


Race^ of 
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Table 3 



'2 Full Factorial Design for Pilot Study 
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Hypothesis 1,1/ For non-residents there are no significant 
differences between program groupis . 

This is the test of homogeneity or absence of 
self-selection amongst the entering populations. If 
there are significant differences between the populations, 
at entity ^ then subsequent differences between children 
in different programs -cannot be causally attributed to 
the treatments. 



Hypothesis 1.2. Amongst resident children there are no 
significant differences between program groups . 

If Hypothesis 1.1 is accepted (i.e., no self-selection), 
then rejection of this second hypothesis is equivalent to 
confirmation of the environmental change hypothesis; 
since the populations are homogenous at entry and non- 
homogenous later on, the treatments must have some effect. 



n 



Hypotheses 1.3 a&b. Group 1 programs have no significant 
impact on residents; Group 2 programs have no significant 
" impact on their residents . 

If Hypothesis 1^1 is accepted (i.e., homogeneity of 
entering populations) and Hypothesis 1.2 is rejected 
(i.e., there are significant differences between treatment 
groups after 18 months) , then at least one of this third 
pair of hypotheses will be rejected. On .the other hand, 
if Hypothesis 1.1 is rejected, 1.3 will still be of 
interest. It tells us that, even if treatment groups are 
not comparable because of self -selection, there are 
(are not) significant gains for the separate populations. 
This is done by comparing, within program groups, residents 
and non-?residents. The difference, when age is controlled 
for, is the imputed developmental, gain. 



Hypothesis 1.4. Family income and race of family have no 
significant effects on child development . 
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Hypothesis 1.5. Race and income variables do not interact 
significantly, with program residence . o 

G ' . " 

This final hypothesis gogs beyond a simple test for 
the main effects of family income and race to see whether 
program residence interacts signif iqahtly with the race 
and income variables, • • . > 



Automatic Interaction. Detection ; ^ 

The tjasic method of analysis applied in the pilot 
design is the analysis of variance. It is recommended 
that the data be further analyzed through automatic 
interaction detection applied to the independent and 
nuisance variables used in this design. The. automatic 
interaction detector is basicklly an analysis pf variance 
procedure, designed to analyze the importance of inter- 
actions among up to 36 variables in predicting a single 
dependent- variable,!.. It Is, a computer program that 
employs a nonsymmetrical branching process to subdivide 
a given sample into a series of consecutive subgroups 
in such aiway as to maximize^ at each consecutive 
branching of the process, the ability to predict the 
dependent variable. The technique differs from conven- 
tional multiple regression^ technique? in l^at linearity 
and additivity assumptions are not requ^ir^d. 

The overall strategy of the. desigrc,^s to find which 
of th,e several independent variables are\most important 

• in "accounting for" the variation in the' ylepenc^ent 

• variable. For a* given sample the total sum of squares 
is partitioned in various ways until that ^partition is 
found which maximizes 'the re;5ulting betweei[i group sum of 

e 

1 ~ — ' — \. — ' , 

For a complete description of this tecjhnique, s^le 
The Detection of Interaction Effects: A Report on a * 
Computer Program for the Selection of Optimal Combinations^ 
of Explanatory Varia|?les, John Sonquist and James , N, Morgan < 
Survey Research, Center,. Institute for So.cial Research) 
University of MichigaUf Monograph #3*5, 1964,.^ • 
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squares^ The partition is usjLd to separate the sample 
into two subgroups, each o'f which can then be subjected 
to further treatment • ' 



The proposed subdivision 
variables are as follows: 



of the .pilot design 



Program Residence 
18-24 months 
24-30 tiionths 
30-36 months 



Family Race 
white 
black 
other 



Program Size (units) 

0-50 . , \ 

50--100, 

100 and over 

jgrogram Unit Type * 
apartments 

tpwnhoif^^es . . 

Program Income 

(% moderate income) 

75-100 

50-74 

25-49 

0-24 * 

Neighborhood Income 
low 

moderate 
high 



Family Structure ^ 

1-parent 

"2-parent 

Family Size 
one child * ^ 
two chiljdren 
"thre6 children 
^our or more children 

Sex of Child 

male 

female- 

ft f 
Occupation of Family Head 
(Parent InterviewX * 

Education .level of Parents 
(Parent Interview) ^ 



Family Income 
very low . 
low 

moderate 
moderate-high 
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One of the interesting features of this technique 
is that the criterion for a split is one of importance 
or explanatory pow^r rather than statistical significanc 
It is based on the notion that although correlation or 
association may not be suf f icient -^to show causation, 
it is necessary. . The procedure is decidedly "post hoc," 
however, and as such is relatively useless as a means . 
of testing a priori hypotheses about the relationships 
obtained, ^he importance qf a' variable as measured by 
the proportion ,of variance it accounts for in the 
dependent variable is itself subject to random fluctua- 
tions. What turns out to be an important factor in one' 
experiment may be shadowed in further experimentation^ 
*by some other variable. 



On the other hand, the technique can be a valuable 
heuristic in a research strategy that permits interaction 
between hypothesis formation and data collection. The 
initial conceptual scheme determines the variables that 
are included in the research in the first place, but 
their order of importance as suggested by the outcome 
of the analysis suggests^ hypotheses , of a more precise 
model than the original conceptual scheme from which 
hypotheses may be deduced and then tested against 
additional data. 



The size of ^ the samples callected in the pilot 
investigation is cons"t3?j?ined by the number of children 
in the programs selected; in particular, the. relative 
scarcity of moderate income programs effectively restricts 
the number of children to be included in the sample. 
Since there are more applications than units, the ntimber 
of families with residence oyer 18 months will be the 
binding constraint. By pooling programs in this category 
it is possible to find an, experimentally balanced sample 
of 108 children. Of these, 24 should be. of high-school* 
age, 36* in the lowest age group, and 48 in the inter- 
mediate .group. ' ; 



>3 . 3 # 4 Sample Sisses in the Pilot Design 
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These children constitute only oh©^ fo'urth of the 
total number of subjects included in the pilot study .'^ ^ 
Additional^" balanced samples will be drawn from the 
Group 1 non-resident and from- Group 2 residents and 
non-residents giving a, total sample size of 432; these 
will be divided between ag6 groups as follows: pre-, 
schopl - 144; elementary school - 192; high school - 96. ^ 
It is necessary to consider the adequacy of each of these 
samples independently,. 



The adequacy of sample sizes can only be defined 
in terms of the ability of the analysis to discriminate 
between alternative hypotheses; in defining what is 
meant by this power of discrimination, it is necessary 
to (distinguish between the null hypothdsis (no effects) 
and the alternative hypothesis (effects) , Unfortunately 
these two hypotheses are not, as stated here, strictly 
comparable. This null hypothesis that the effect is zero 
is a point hypothesis while the alternative hypothesis, 
that the effect is a non-zero, is composite in the sense 
that it only restricts the hypothesized level of the 
effect to a range of values. To avoid this difficulty, 
it is necessary to ^define the alternative as a point 
hypothesis specifying precisely the size of the effects 
obtained^ when the alternative is' specified in this way, 
it is then possible to define the powdr to discriminate 
between hypotheses in terms of the probability of 
accepting the alternative hypothesis when it is true. 
This is called the "power" of the test. 

' WithfLn each age igroup, there is a set of observa- 
tions to be made on each child; these observations are, 
drawn from populations with different (and generally 
unknown) means and variances, and numerical specification 
of thQ^^alternative hypotheses in each ca^e is clearly 
an arbitrary and time-consuming undertaking. To ^ 
avoid carrying out separate calculations for each test 
and each age^ group, it is sensible to define scale-free 
alternative which define the hypothesis in .terms of 
percentiles of the, standard deviation of the measure. 
Inevitably there is an*" arbitrary aspect to this, but it 
nevertheless constitutes a viable and useful means f^r 
reviewing the adequacy of the sample size* ' ' . 
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For- the* purposes of this discussion^ separate 
computations Were made for two aj.ternative hypotheses: 

(1) The effect is greater th^n or equal to 
half a ^standard deviation of the measure 
in the subject population. 

(2) The effect is greater than or equal to 
one standard deviation of the measure in 
the subject population.^ 

y . 

Testing the null hypothesis at the 5% level, the 
power of the test for th6 levels of replication proposed 
for each age group in a 23 factorial design are as ^ 
shown in Table 4, ^ 



It is not surprising to find that the test has 
only limited power when the alternative is. less than one 
standard deviation away from the null .hypothesis. This 
suggests that for purposes of making decisions about 
how to proceed after the data from the pilot study have 
been analyzed, use of a lover significance level on the , 
null hypothesis, may be indicated. This problem is 
addressed in the simulation discussion of Section 3,6. 



^These alternatives represent non-trivial changes 
in measured levels .of development. ' For a test such as 
the Wechsler wjiich has a mean of 100 and a standard 
deviation of 20, the first alternative . indicates a gain 
of at least ten points. 
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Size of 
treatment 
effect 
under 
alterna- 
tive 

hypothesis 



Nvunber of replicates per cell 




6 


9 


12 


0. 5a 


0. 40 


0. 55 


0. 68 


1.0a 


0.93 


0.99 


i.oo 



Table 4 

3 1 
Power of 95% level «E Test in 2 Factorial Design 



^ iSee Tana. P.C.. "The ,^power function of the analysis 



oee Tang, P^.C., xnc.^t'uwer runction o£ the analys 
of variance tests with tables, and illustrations of their 
use." Stat. R6s.:Mem. ,' 2, pp. 126-149, l?18*s' ; . . - 
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3,3,5 Costs^ and Schedtiiing 



The pilot design calls for^ tests to be administered * ^ 
to 432 children -at six Ipcatioxji'. ^^These children will 
be drawn from a larger population which must be surveyed 
for purpose of sample selection. The ' estimated costs ^ 
of the pilot investigation, including survey and test 
work, data analysis, report preparation, and project 
administra^tion are as follows:' 

Estimated Costs of Phase I (Pilot) Investigation ' 

1. Direct Labor . ' . . 

Project Direction & Data Analysis 

1 Senior Principal Scientist 6mm @ $2,500 $15,000 
1 Principal Scientist 6mm @ 1,500 9,000^ 

1 Clerical ' 6mm @ 750 - '4,500 

Survey and Testing Families 

432 '@ $80 ..^ . * . • 

(includes coordination, training; 
coding, but no payment to family) 34,560 

V X^./i-. . TOTAL DIRECT LABOR . ./ ^ - $63,060' 

2. Overhead at 100% of Direct Labor 63>060 

3. Travel -i*^ 



36 trips @ $^50 average 5,400 
240 per diems pei^ program @ $25 ^ * g^Qoo 

TOTAL TRAVEL , . . / - 11,400 



Overhead charges might.be significantly reduced if ' 
interviewer salaries are, not included^ ii> the direct labor 
ba^e."' Policy with respect to this varies between contractors 
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4. Conlputer Rental * , ^ • 

V . • 10 hours at $425 . * $4,250 

TOTAL DIRE.q.T COST'. $141,770 
[ 5. General,* and Administrative - Expense - ' 

^t 15% of Total Direct Cost ' ^ \ ^ : 21,265 

TOTAL^COST . ' $163,035 




The* pilot 'study can be condpcted on a relatively 
tigKt schedule if the project is well administered.. The 
average number of children ;per program is. less than 90, 
and with 4 interviewers and 2 testers-, .this can be 
completed in less than '25 wprJcing fiyais. Allowing for 
start-up, on-the-s^te training, and unforeseen circum- 
stances , each prpgram could be completed within a 
period of two calendar months. Allowing a further two - 
months for data^ analysis and report preparation, the 
schedule of activities is outlined in Table 5. 



The PJiase I (pilot) study will require 6 months to 
complete and will cost in the neighborhood .of $160rOOO. 
The experience gained in the conduct of this study will, 
together with the data themselves, provide a necessary, 
input for the Phase II effort. . 





Start-up / 
Data Collection 
Data Analysis ^ 
Report Preparation 




Table 5 '\ - ' 

Schedule of Activities — Ph^se I (p'rlot) Investigation 



r 
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3.4 Non- Experimental Design Phase II (Cross-Sectional) 
3-; 4'.! Objectives of the .Phase II Study ' 



The objectives of the second phase of tlie non- 
experimental design are the "explanation" of significant 
effects observed in the pilot study and the. assembly 
of, baseline data for the third phase. If there are no • 
differences, then either the Miypothesis of environmental; 
change is false or the length of time elapsed since . 
entry into the program is insufficient for these effects 
to become apparent. The existence of differences does 
not, however r necessarily lead into the second -phase. 
If the entering populations are not homogeneous in 
the sense that there-'^are significant variations in the 
developmental levels of children- entering different 
programs, then the observed treatment effects cannot ^ 
be causally attributed to variations in the fdiiar-acter- 
istics of the sampled programs. Necessary pf eoonditlons 
for the second phase investigation are the acceptance 
of 'Hypothesis 1.1 of the Pilot Study and the rejection 
Of Hypothesis 1.2. If only the first of thpse donditions 
holds, it. may be necessary t6 go directly to the longi- 
tudinal investigation. 



In stating tfie objectives of • the ' second phase 
study, it will be assmed' that the above preconditions 
are satisfied; the homogeneity, of the entering popula- ; 
tions insures that the programs .are comparable and the 
/keteroaeneity of ,the resideiits insures that, there are 
. . " some diffex^nces to "explain."" The explanation of -these 
differences ^^1 involve comparison of programs along 
two dimensionsr-the income mix of the program neighbor- 
-f^ood and the iricome mix of the program- dtself . The , 
."^ ■' principal objectives .of the second phase study are 
^' ' therefore: ' " • ' / ^- " * 

(1). Test of the hypothesis *that -the income mix . 
0 •„ ■ i , of -the neighborhood has 'an effect on the 

' . . outcome measures . 
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(2) Test the hypothesis that the- i^ncoine mix 
. of the program -itself has. an effect on the/ 
outcome measures • 

. .. . • _ , / 

Secondary objectives of the second phase ^study are: 

(1) Analysis pf the effect of the independent 
family variables ... 

(2) Additional testing for self-selection amongst 
program applicants, 

«- 

These -objectives will be realised by an extension 
of the pilot study to include more programs, and by 
the -elimination of those outcome measures will sho^ 
little change in the pilot study. Procedural changes 
in the second phase should reflect the experience gained • 
in the^ first place. * ' 



3 • 4 • 2 Selection of Pr'ograms for ^ the Phase II .Study 

The programs required for the Second phase reflect 
the need. to achieve contrasts between programs along 
both of the dimensions of— in^terest,' The difference 
'between the first and second phase studies in their '^ 
treatment* of programs corresponds to a change from a 
binary classification of programs to a fourfold classi- 
fication, Thi^ is shown in Table 6. 

' ^ This in no way prevents the subsegueiit analysis 

of data , either through analysiis of variance based on a 

3-way classification of neighborhood SES or, as recommended 

in the Phase P study design, through use of the autpmatic 

interaction detector. By classifying neighborhoods' 

3 ways, a 3x2 design can be developed as shown in 

Table 7. . , - ' . 



5»» 



6.^ 



6 o 





Neighborhood Income 


High/Moderate 


Low 


1 Program Income 


Moderate 






I 

1^ 







Table 6 

Program Variables in Phase . II' Study 
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Alternative 3x2 Form for 2nd Ph^se 
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The 3x2 design has many features ta recommend 
it, particularly when "the study is viewed as anvinves-- 
tigation of acculturation effects; it may, however, be 
difficult to implement without the inclusion of more 
programs. For this reason, the remainder of the 
discussion will focus on the 'basic. 2x2 program classi- 
fication. 



^.4.3 Selection of Outcome Measures In Phase II 



• 

The selection .of outcome measures in Phase II is 
entirely dependent on the results of the pilot study. 
Measures which show very little, evidence of effects can 
be eliminated from the test battery,- arid in this way 
an opportunity is provided for either extension of core 
measures which do show some effect, or for reductioh in 
the length (and administrative cost) of the test battery. 
It is tempting to suggest formal rules for this process 
of elimination and substitution, but reflection on the 
nature of such rules suggests. .that they would be very 
complex and ultimately a poor substitute for good 
judgment. It should be noted, however, that where * 
extended measures are introduced, it will be^ necessary 
to carry out additional measurements at the ♦Phase I ' 
sites. This additional cost is not 'incurred if no 
extensions are made. With this reservation, the costs • 
of survey and measurement will be assumed to, be th^^ same--, 
as in the Phase I study. » " v,.^ 



3;4.4 Design and Analysi s in Phase II ' v- 

The methods of aTiaiysi$*^ employed '.in Phase 11 are 
essentially the same ;as 'those of the pilot 'Stajdy-;. 
I^jiste^d of a 2^ factorial; diesign, however,, it Ua riow 
a . 2^ design with two independent program clafssif ications 
It is n6w reviewed "in the framework of \the analysis of 
variance. ^ 



It is convenient to being hy- gbnsidering the ^ 
design^ as applying to a single measure on children of 
one age grouping. The associated 2^ factorial -^layoutr,. 
is" shown ih^Table 8. The pilot study ^ although laid ' 
out as a 2*^ factorial design, was principally .analyzed 
in only three dimensions. Similar considerations .i^ad ' 
to. the reduction of the second phase study to four dimen- 
sions for most of the ^analysis. The choice of dimensions 
to be eliminated reflects the nature of the particular 
hypotheses of interest. , \ ' 



Hypotheses^ 2. 1-2. 2. There are no significant differences 
in the development levels of non-resident children 
families with respect to the program variables .^ 

* . » 
-'This is -the* test of homogeneity or absence of 
gelf-selection amongst the entering population. Jf 
the test w^s passed in Phase 1/ this represents a 
reconfirmation of the validity of inference in the 
sfecond ph^se. These tests — one for each of the program, 
classif icationsj-are the .conventional tests for, main 
effects in a ,2^ factorial design. * 

Hypotheses 2.3-2.4. There are no significant differences 
in the develppment of resident children with respect to 
the program variables ., » " ; . , r 

" » V * ^ 

* 4 • 

AS in the pilot- study, if Hypothesis 2.1 is- .... — 
e^accejited (i^e.,, po self-selection on .the first program 
variable) then rejecticgi of 2.3 is equi:C^alent to 
confirmation of the hypothesis of environmental change. 

Hypotheses 2. g'-2. 8. Within. each of the 2^ program - " 
classif icationsy thelre are significant gains in child , 
development ; \ . ^ ^ . ^ , • '\ 

> Xf there ar.e-^-signi^icant s61f -selection effects * 
'discernible Iwhen the developmental levels of program 
entrahts ajre compared, it will- be im^ossib^e to miake._> 
use f^iil^Jfiom'palri sons between programs.. Nevertheless^ it 
may., still be pSssible to identity gains due to envir- . 
onxaental change within each of the ^^ight program groups* 
This is* done by comparing residents ^with entrants for each 
,9rrpup. * ; . . 
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t 

Yes 


'Family 
income 


Moderate 


' Low 


^Moderate 


Low 


Race of 
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2 Fully Replicated Factorial Design 
for Phase II Study 
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Hypotheses 2 > 9-2^ 10 > Family income and race have no 
significant effects on child development s ^ ) / 

e Both these hypotheses will be tested in the full , 
2 factorial design. * 



Hypotheses 2,11-2. 12 > Family race and income variables 
do not interact significantly with length of residence^ . 

This is the. compensatory hypothesis outlined in 
the discussion of analysis in the pilot study. Signifi- 
cant two-way interaction between these variables would 
suggest that gains are not equally distributed between 
program entrants or different income and/or racial 
background. • * ' 



As in the Phase I study , the analysis should not^ 
be restricted to the analysis of variance- alone. , 
Partitioning of independent ancJ nuisance variables ^ 
for use with interaction detection; methods will be used 
to uncover significant . inter-relationships not included 
in the basic hypotheses.., * y ^ . 



3.4.5 Sample Sizes in Phafse .II 



The size of the samples collected in. Phase II is 
constrained by the number of children resident in the 
programs selected; again the relatively* small size of 
the high income programs is the binding constraint. 
The pilot investigation called for a tota]^ of 108 
children to be drawn from families resident in ^h^se 
three programs . , Since these represent 6nly one-eighth 
of the cell in the design, the total sample size will 
be 864/ 02: exactly double the size of the Phase' I 'sampler 
These will be distributed amongst age groups as follows: 
pre-school - 288; elementary school - 284; high school - 
192.. The adequacy of these sample sizes is now co'ilsidered 
in terms, of their ability to discriminate between; 
alterhativ,e hypotheses. . ^ ' 
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Ntimber of Replicates Per Cell 



Size of treat- 
ment effect 
under alterna- 
tive hypotheses 





1.. - 


9 ■ 


la 


0.50a 


0.67 


0.83"' 


0.91 


1.00a 


0\§9 . . 


, 1.00 


. 1.00 



Table 9- 

Power of Test in 2^ Factorial Design^ 



Computed from Table of Tang, P.C. , o£. cit . 
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•In* the conte^^t of the proposed 2^ factorial 
design^ there will again be 9 replicates per cell in 
the pre-school group. The power of the^ test of the null 
hypothesis at the 5% level is* shown in Table 9 for 
each level of replication in a factorial design. 

This is done for two levels of the alternative hypotheses 



The Phase II design has considerably more power 
with respect to the alternative hypothesis than the 
Phase I design. This reflects the increase in the 
niomber of factors which more th^Ln offsets the reduction 
in the number of replicates. 



3.4.6 Costs and Scheduling 

The Phase II design .requires the administration of* 
tests to 864 children. Of these ^ 432 'children at six 
.locations will already have been surveyed in the pilot 
investigation. The incremental costs of the Phase II 
investigation reflect the additional survey requirements^ 
together with a similar budget for, project direction 
and data analysis. 



Estimated Incremental Costs of Phase II Investigation 

= ' 7 — : 

1. Direct Labor 

4 

Project Direction and Data Analysis 

1 .Senior Principal Scientist^ 6mm @ $2^500 $15^000 
. 1 Principal Scientist 6mm @ 1^500 9^000 

1 Clerical - 6mm @ 750 4^500. . 

Survey and Testing 

432 children \ @ 

(includes coordination^ training^ 
coding,, but no payment to family) 
* 

TOTAL DIRECT LABOR 
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. -a* ' Overhead at 100% of Direct La^or 

3. Travel 

36 trips @* $X50 average 
240 per diemsVe '$2^ ; 

TOTAL TRAVEL ' ' ^ ' 

4. Computer Rental 

Includes re-.analysis of Phase I data 
20 hours ,@ $425 



63,060 



5,400 
6,000 



11,400 



7,020 



TOTAL- DIRECT COST 
5. ■ General and Administrative Expense 
' at. 15% of Total Direqt Cost 
TOTAL COST 



$147,020 



22,053 



$169,073 



The estimated total cost of ca'rrying the study thrpi^h 
both Phases is then: • ' » 

. ; Phas4' I $163,0*3.5 
/: >. ' Phas^- II - . 169,073 

TOTAL PHASE I -AND PHASE II' $332, '108^ 



/' i^S^f payments to "failles are included, this would, 
■ iti'er ease the cost by. $8; 640 for $10 payments and by ' ,C 
$17>380 for $20 payments. / " 



-1 ; 

■\.r-. 



'i 



- } 
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The s.ecpnd phase- s'tudy-can be carried' out on a* 
schedule v;hich is essentially the same as tfiat, of the 
first, ph^se. Allowing for a period of ^ three mc^nths . 
between first and second phases in which to circulate 
and review the findings, both phases can be completed" 
within a period of , 15 months .at a total tost of Ipss \ 
.than $350,0.00, not including payment of fees* . . 



#••1 . I 
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.3^5 , ^on-^xi5eriine'ntal Qesign Phase fiT (L6ngi€udinal) . 

. V* - ' • « - « \ - • ' ^ 

".' Objectives of the Phase II-IL Study > : '\ • • 

' ':■ / / > • /' • . ' * ■ 

The sedond.^phase of -the .nbh^.experimdntal -desi^ 
; . differed -from -^the first in- that it enlarged the number . 
o^. hypotheses. .vhich could be investigated • . !;The differ- 
-.ences betweeji, the secpnd* and,' thixd phases are of a 
. V different, nature.; ,Ins1:ead..of ?nla^g4,iig .the design to. 
. include more ..programs and more ^progtain dimensions, 
the. thiTd phase -e^t^nds the second^ -over time to permit 
V V ' .a :mpre. accvf-ate- and^^^^ of the 

' \ . findings to..date. / T?here.^„rfe 'two principal reasons why 
- . the, longitudiriai ihyestigatio;a of Phase- III can lead 
'".Vl / V Vto/m^^ first relates 

,\ ^ ' > ; ■ td the. within -cell - variance x>f •t;he 'design • The second 
/ . " .concerns, the* length of time , over which treatment effects 
• ^f>.V:V/ Vare!^ plaiee*, .Those are .now reviewed 

V-.V^n.tiie^c^^^ of both the first - 

[''.• 'i^^^^ the within cell 

^ , V vari anbes' .c^^^ variances across the 

'V'^^tVpopulatib'^^^^ iriterest. / Tiilas,;.,i:n simplified model, 
vf ! ^/i thfe. scores of „*fesxdeht ^.sfxV.yea bids are contrasted 
. '; /witht^^ olds.* In the 

"/lo^rigiitWinal'dct^i are estimated 

/'^ oV, by .'cbmfcyaringV't^^^^ groups of six-year 

/" V-, bids* over' and the within 
/,/ •/ cell, vax.ianfcW variances rather than 

V. . ,ther. popiiX This reduction in within- 

; . * . . *c.ei)i: varaa^ considerable increase in 

\ - *'> fthe jibwer.'bf the ';l:ests ..used, in the basic analysis of , 
1 ' , ^ var.iali'ce • des ign • ^ " ^ , } /• • \ . 



/Title' :^^cbnd<adyanta^ longitudinal design. 

! de|)ends up6^i. Judgmental.. ^a.^ than statistical con^.i- 
deration^* /"i'he progtams .included in the ^eTcond phasfe,. 
- - of -.tliie study, a^e .coinparatiyely neV, arid few of the 
V ^b'etter . prograins^Seing'm^ y^ars qX&. This ^ 
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raises 1±te. question ^of v?hetjfe or mt l8r 36 months is ^ ^ 
' s»Cf iqieiit* length of * time, to: aX16v> -for . diseerniblS 
. effects on dhiiarela tb^ take placed If ^it is; not felt 
to bfe long, enough^ and^. xf • the second phase Study provides 
only limited suppori: for^the'h^ppthesis of envirb^imehtal 
' eff ects^r 'i:hen the longitJtadinal ^tudy become^ .of Iti^al 
. to the jiuccess of the non-^ex^eriment&l 'in^;:^s,tigatipn• " , 
. If ^ on '-the other hand^ the Sjscoijd .phase prQVides^ coii^^t* - 
si<aerable '^pport ^or^ i:he-bas±e hypotheses; -^he Gorro^^rr 
borative aspects of the longitudinal^study are^x>l - ^ ; . 
considerable value. - - - ' ' ' 

' . ^ ^ ^ * . . y , . , 

V The objectives of the longitudinal study , can b'e\.. ' 
stated in Metros' of the reinfprcing or corrQborat;ive * * 
value of the analysis it /permits'. Xt. also ' brings with-, 
it certain problems, such as- attrition;, which are'^not'-/ \ 
present in the ^cross-sectional desigii^.-' -Thfese aj^^er 
dealt with in tfee^.sections that follow. ' •VW ^ 



3*5 • 2 Design and Analysis 'in PhasevfEII /V. 

, * The^J>asic-m^thod,^9f»-analys^^^ in the tJjiM 

jphage of ' the'non-e?cperim^tal -d^si^^ r'efnains /t^he . ^ • 
analysis of -^variance. ^ This^.is -apj^J^ie^ tp\compar^^ 
\'bf X^sidents im different programs'^ who 'have tfaip en ^\ 
exposed t^ the ^afea^n^yt pf , intfe^^^^ ^ 
length of tipip. Compaxispn^' ar^^ade onZ-the basis, of ^ 
measured gaii^s oyer- the pejripd intervening b^t\?reen.' . / 

li measurements and^i sedo'nd wa^e Tof omeasfi^ 
iftents. (Phase III) . ^ TbeXe are^ as^will become ^pp^reint/ 
•problems iw 'Controlling for the ' 
'in eacfh ceil; \beqause 6t rabbility Iri the subaedt popula-, 
tions . The^ prpblems,'Wi ii, be .4ef errad-mpment:arily in 



r-f -pr4ea? to ,ei^plor^,. tKe .effects, of .controlling forvjE^di-^i- 
■^t i.-^ i&t'&l^ longitudinal- study* .., 

--. " .In-the-dross-sectiohal;,^^^^^^ basic, test* 

,^ '. Jfot homogeneity in tfte, ^nterinsT populations is equiva- . 
-* .^en^.tb ...sT t^st that the children and 'families 'ojE, .grpgiam 
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^ applicants ai;^ all drawn f rom' the-^saitje population^, 
rega?rdies^;of tlxe, program to w^ich -thq family has 
-.Applied • Gains\a^€^ ;then estimated iihplicitly as the. 
differences bqt^eep the /meas.ur6d development of resi- 
dents and -nbnvresidents when ^alj' other variables, have 

•been coqtrolied for;, * = 1: - . 
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" Ifein tainxn^ * tlie 7rferiglEh~~6r ~r e s i<5q'hce variable . 
; dojistant^.- and as'5;aring the yariahce In' score? to' be 
/ ^\ e<5!aa-l^ for both populations, it is' ppssible .to . 

% fcomj&are tlje within cell; variance of the. cross-sectional 
; '^m'.*Jongituainal .designs. , Let y^j^ denote the 
; mea'suf ed . deyelopm.ent of 'the k^^ child in the ith . 

'time period Uge is 'controlled: for) . Assume two time^ 
• ^rperibi^s (i=^),.'l) let the: (common) population variance 
\ ^ .y^ithia- ^ach time period be denoted by and let. , . T 

^'tl^s test-iretest cbrrelation coefficient be ^denoted by 
, *• Now. tioicpare the variances* of gains estimated' by, 

(.1) diffetence^^ in 'mdfasured development between the -\ ' . 
: same'^individual at -difierent^^imes, and "(2) difference?, 
in measured .deyeloplifeht' between different indivictiaals ; 



i different points' in time: 
. .. .. . , ^. . V 



r !Phe- ratio. Qf. /these two, (1-p) , gives thfe, r:feiat;tVie.yri^^^^^ >/ ''^v 

f efficiency of the two estimates of the cell m^anxv^^^^^ ,*Zir ? 

• .,for a test-retest correlation of +0.8// the/^^it^in' 
. fairxahc^/ is- reduced 'by 80% and the ^tandard^.dWi^tibri ^ 
by^aimpst 60%., This dramatically ijricVe^sfes the .powe±^^^ 
of the; test with respect to alternatives -^speciii^d^^^^ 1 . ^^ - 



' .terjns of popuXatipn standard de\^iatictn.*/i 

. As :.the length, of time iDetweeri 'sepaijate si>rv^&y:'yaveS'\ * P 
' increases,, the. correlation between test 'and rj^teat. Mil \ ' „V 
/'char.^cteristacaliy decline and^ iri^ this .way, th^r^.V^^ 
be^ sbme ^loss i'h efficiency • . Tfiere ..will/ 3ipv?ie\^eV>,^^ , . 
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.more powjsrful influence working in the other direction>, \ 
since it is reasonable to suppose that the effects of 

* environmental jcharige will be greater over a longer time 
period.,- ^Since the effects*^ if therfe are any^ will 

*pr6bab'ly increase more ^consistently than the test- 
retest -correlation will decline, the net effect of 'these 
two influences. -will fall, other things' being .equal, on 

- the-S'ide- 6£ a * longer run study . /-v' — ^ - - 

Unfortunately, things are not entirrely eguaT for^^* 
:two reasons.. In' the first place,f "gainst can -pnly ie / 
estimated, if the measurements on xndiy;Lduals are carried 
out bh t;he sam^ sc^l^' ox if _ overlappxijg^tes^s .kre used 
to consolidate broader, ag'g, ranges. ^ if oV'erlapping tests 
ar.p not available for^ all ^dimensions, of interest, , arid . 
if:, the limits of^. applicability are exceeded, tlien .programs 
cah. OQiy be compared\pn the basis; bf ra\/ s:<:|pres for , \ 
.matched groups in different programs. 

.XJ5 essentially a..c^6ss-sectional .study.^.wljich. cannot be \, 
:dohq".for several years until the chi'ldreii get older ^. ' 
I'bese con:dideratiphs strongly suggest tha^ the second 
wav^e. shoald be carried out within 2r3 yeairs vpf tije , 
;f irsH? .wave, " - ^ ^ ' ^" r-v- -'r-^r^^ 

5.he secohd constraint on the.length pf time between" 
/Survey .W^ .the probiem of attritions A:ftritipil . ! 

/interfere$..-wit the design and. analysis' xn two. ways: 
'<Sxi% pt^ '^ is preterit ^ although heavily \ 

.qpnceale^^^^^^ the cross7sectionai desigii^ and: both 
;air^ .'preSen^^ longitudinal-.design. \'\ 

^ ''.7 The first ^ difficulty created' by aitritipii is the 
problem of self-selection over time. If * chxid develop-. . 
,.-aeiit.\xs',^orre ^/ith mobilityr-with the. more (or 

ad^ar^ced children, being mpre. (or less) 'likely 
-;tp?,moye/ of (or into) . th,^ programs,, then . , 

there Is a bl^s in estimates,,. of gains, baised^on cpmpairispn, 
'.Of. riesx<lents^\Snd honrr:,esidents. .IThis /xs a source of' 
bias present .in- both the \ cross-sectional and .longitudinal 
.jdissxgns*, .The second diff^iculty .is created even, if mobility 
is. cpmplet^^^ uncorrelated with the'butcome measures. 



because attrition will.. lead ta smaller /and more un- 
balanced samples,, with'^consequ'eht loss of power to 
discriminate. This is a problem which belongs only 
to :the longitudinal design. 



The second problem is. more serious and can be 
compared exactly t-o i:he problem of family self-- 
assignment to programs. Where families entering 

/different programs differ with respect .to variables 
important to child development, it is' not possible to 
attribute observed differences to the effects of the 
program. Similarly, when the fami:i.ies which exit 
programs are not comparable across programs, it may 
not >be possible to attribute differences in the out- 
come variables to the effect of the program working 
itself out over time; rather, it may simply reflect 
high turnover amongst a nonrrandom subset of the 

, sample. 



This is a potential problem in the cross-sectional 
as well as in the longitudinal design^. Since gains 
are estimated by comparing residents with non-residents, 
self-selection across time may undaafmine cross-sectional 
inference. In the longitudinal design, although the 
intervening time period is longer and the potential 
self-sele(5^ion problem is correspondingly more serious, 
there is a simple and direct means of testing for the 
presence of self -selective effects. This method provides 
a method of validating the findings of both longitudinal 
and. cross-sectional analyses. 



It is useful to begin by considering the baseline^ 
data provided by the Phase II investigation as divided 
into two groups — residents and non-residents. At the 
time of the second wave of 'measurements, the original 
resident sample will consist of families who are still 
resident and families who have moved. Reanalysis of 
;the baseline data with mobility introduced as a binary 
[factor can then serve as a test of inter-temporal 
*s'elf-gelection. If significant differences in the 
.development levels of those who moved vs. those who 
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remained are found., tii^SNy/ill have the effect of com- 
promising the findings ^of the. study. If they are not 
found, -this will serve'to validate the findings of .all 
three phases of the experiment. This exercise, which \ 
requires ^no further measurements to be undertaken, 
is therefore recommended whether or not the full Phase 
III design is implemented. , 

The non-resident group will itself have a pattJern- 
of mobility, and this is a more complicated problem 
in some respects. Program applicants included In tli5 
baseline (Phase II) survey may either, by this time of* 
the second wave, have entered the program, have not ^ - 
entered the program and remained in their original 
location, or have not entered the program, byit moved' 
elsewhere (including possibly another hp,us,ing program) . 
In each of these cases, the role of' the baseline 
applicant group in providing necessary contrasts 
requires special treatment. The alteirnative approaches^ 
to this problem are" now reviewed. ; . , 

It should be remembered that the ' principal objective 
of the Phase III design is-, to compare gains in child 
development across programs. In the Phase II 'analysis, 
the role of the applicant' group was twofoldf .(1) to ^ 
provide a test of homogeneity in .the entering populations 
and (2) to provide a means for estimating gains oh ^ a 
program by program basiia if the ,test of .'homogeneity , 
is rejected. Since the Phase III design .should not. be 
implemented if the test fo?:^ homogeneity is rejected,' 
and since the Phas^ III design qontributes :no newV 
insights into the question of 'homogeneity amongst 
entrants, it is not . clear ^ why * further measurements _on 
applicants should be undertaken. Those applicants who 
do enter the program in the intervening period will ^ 
differ from the original resident group with respect 
to length of residence, and therefore the two groups 
cannot be pooled in any convenient? way . It is therefore 
sensible to eliminate the original non-resident group^ 
from the second survey wave. \ . ' . 



54 




o 



^ ".Th6 :effect 'df the j^^limiriatipn. of the non-resident 
, -^-gro.up loiigity^dinal :djBsign^is- to limits the . , 

• * iiypothfe'ses of interest^ tb .questions of re lative , gains 

In different housing 'enydroiimeri ts /It 3C5^no longer 
r\ pos siblQ 9 . theref cir.e f to make ^ jpiJginein.ts *v/it:h respect 
\ to/sibsolute gains f .pin the s.ense of a coraparispn between 
. the dbyelopmelit leveis^of children j»rt a. given housing 
, prpgraitl-? with What' the faraily,' 

liad npt/ entered the •.program* . -^o dp thxs it'^would be 
^ .necessary to resurvey. all .appi ioants ^ wliether 'or npt e 
they moved^ ih the interim periods Not, only- would .this 
, ;b'e an extremely costly and , doubtf ul undertaking^ but * 
... 'it; is: .also riot clear why be^iter ^alternative housing 
, oppprtunities in certain metropolitan mar.kets should 
, be reflected in reductions in ^the estimated *img)act 
r . of good housing -programs* ,Nor can. this be. avoided by 
!.r^testing only those applicant^ families* who fail tp : 
mpve, since this mefrely introduces a ,f uxther element * 
of self-selection* ' , ^' / * • \ . 

':\ : / . - ' r. , \ I ^ 

To'^ummarize the badic s^ategy of, the Phase III^ 

. ^ ^'design.;in terms of th^ collection of data^ ii; i^^'us^ful 

v-.Ho^i^i^^ three definJri^ choices: „ *' ^[ 

--^V • ' >The 'Plias-e III design ihyp Ives " a 's^cprid^:^ 

, \-:'c:}^^'^[y^:;' Vave survey of the Pha^e Tl 'programs.. ^ 

-C ; * , (2)^ ' The secpnd 'wav6 sh^uld^ ipe carried out* * * 

2^-3' years. of the 'f irs't -way? . 

4^) X?^^- seppnd wave should orily include; J*. \s ^ 

' 1:^ "^/>.v^^^ program residents* ' . ' ' 



..;?.Tlir^^^^^^ types of analysis sfhould be carried * 

, .put.in th^.. th^^ of this study* There' are review^ipi V ^^ 'v* 

'•..in turn ' ' 



' tfypofehesis '3>i*-^ TherV ar^^^ ' \ 

^^' gn baseline levels of deV^ropirfentQ-be^ween -childre'n of - 

the ^or^lginal resident gro\ap v^ho" rema^n^ iB. ^h'^^ program ' . 

p * \ iagld fehildrgn who^ are h6 i'onger i h the prograiff * ^ \' >; . z^ ^^Hf :." ** 

k ' r-. -.1' .-r^ y \ '^"'i' ' - ' -^ - — ' — " - ' Jo.j'-.i', V/' . ^^-v-. , •--•{'-^ru^^:^: 

^ . - f'- . . -- . -^-0- ^t^^^^^^ ^ 



. - This test involves, reanalysis' of the Phase ■•II data * * 
. on two-^y^ear^ residents.* Substitution of "moved" vs.%^, ' ^ 1 

"not moved" for program residents in the Phase li '* . , ^ , 

design permits ,a test for this main effect in tiie. * ' " ' . ' 

framework <^f^a^^ 2.^ f^actorial desigi). Classification 
- of Jfamilii^g' acdording to mobiixty is 4one' on*- the basis ' 

of ^at? ccjllected on theisecond wave.' The unbalanced"^ 
^ nature of the design make^ the test statistics somewhat ' ' ,j 

more .complicated.. ^ . , • . ^ 

Hypotheses 3.. 2-3.3. There are differences in mean • \ 

develppment gains. along the dimensjLons of neighborhood ' " 
• '- incomfe and program income . .r;, ^ ^ ' ^' ^'V 

[ The* tests will 'be conducted within .the 'analysis \. ^ 
of Variance framework on the. original resident groqp^ ' / , 
only.. The dependent variable in ail c^^ses Is the ' ' ' • , • 
/ 'measured gain over the period. These are the tests* ; \ . 
of the basic ^environmental hypotheses. . •/ ' 

' Hypotheses 3.4-3.5. There are differences .in the' mean ' . 
gdins for fanjilies of dif ferefit race and income. . ~ " 

.'Thesje again are. conv^ntibnal tests of . the- impact i,,;,...^*. ^ 

-pf family, variables f but this time they test f or. gaj;ns v. r:*/ 
rathef.than absollite levels.* The' compejn,s a toiry' hypotheses ... 
. which "we're,. originally investigated 'thr.ough twpr^v^ay " . , , 

' interactions between family yariabjes and jLehgi^ of'.V , ' [\. } 

i residence .are not tes|tgd as, main, effects •'^.'*P^i^i^• ?: \ > ' _ 
iyicome will be * defined **as th^e* family^' s .iri?.<^?fi^. itfie,," v .re- 

time of entry to^ the program. ^'^^ \-^}^.y^\ • . v' V* ,/>W^?' -1 * ' -V^^^^ f 



T.; ' V, 3-#5.3 ; gample Sizes an Phase, III . : ^ \\ »^ * , .r " 



; ,Tfie/si;?e of *th^ pbpulatiofxs ?,sanip-Xed in Phase . xil ' . % 
of tbi^ design is, es'^sentialiy determineij .the Ph^se -tl ; . 
de^gn j^'G±\refn that only residents, will 
the final phase, the. number oJE/childrej;i to be s'ainpied. ' / J.:; ^^^^l il^,-..!^ 
i^ given 6y the- size of the Original iresident^ group '^.^1*^ . ; : V' 'tl 
less iosjses.from tlie original; resident *group,^' ; "^^ - 
would plaoe Ithe maxiraunt saiaple, s'ize' iri the final phas^ '.,. * 
at 432 children f distributed as fo3.lbws'i ,pre*-scljooX V -^^ V-^n 
192; elemelitjary school - 256j^ and^^fii^^h* school - 128.:/\ 'V. ^ 
The actual number'- will be sjlgnificantj.y^/iess by. ' ^ ' ' 
reason o'f attrition.* " , /. v ' * , \ \;V ^^ 



^he power o^ thj^ t6sts^6f. magili effects wiH:hiQ i:he - 
.2f^ factorial design' is shown iist'Tabi^e lb for* each ' 
. Idvel' of replication and^ asstimiiig, , z,efo attrition. . ' 
■^Alternaeive ^hypotheses, aye; again- stated iri: tferins of 
• . thje pcJpulatida vgiz^i^nce/ * bu^^ the power reflfecfs the 
, within cell vari^pe. of', gains. This; is eguaT .to ' (1-p) 
/times, the population Vai^i^nc^^^^ \fhete'.: ,p\l .detjotes th^ ' 
_ * ^ test-rfetest -cor'reiati^^ is assumed-^- 



: 1 / to bie; 0^7.5^ for the ^putposes' fof - e^timatjLng^ power. 




1 , ^ 

/ A 



"tb/see\tnat these tfests, have ^very .l^iigh: power to 
^ <3i5Cri,minate Between l^ie.jiull ..and "aJtterniative hyp6theisi§s. 

'u - "-vJ. • . ,^ „ v - , ' , ' ' / • ' / 

;■ V . . ",3> S ^ 4 Costs laft'd'\^Schediilihg , " ' 1 / 



_ . - • ^ The f ilaal phase,, pf- 'ther' design 'res(^m^ the first 

/and secgnS pha^es^ in ,the sense ^ that the .xiimber of ^target 

*' ;;;chi:|drenf',t^ althqii^h mobility and the . 

. 1 , previous sair|>.^^^^ will reduce,' the total 'niamber 

or^^'j -I J ^--r^^ tL^ -..i^ — i^^ji ^t^^ i^*x^^^^4 — 1 ^*^3s *reguire 

and Xl' \ 




- ' 7^ ^^^^ 



♦ s 



pA^i ,y --c' '-^^ : •' ' 

l^v* 'X ' r: -.'•'•^"'•s • '.'-V y;;:^, 

|-"^" v^. !"-!* \ -^^ V-"^'-''" 



il'umbe^r of' ^'R^plicates'^ per CeL].' 
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:;. e'" . • 




• .12 
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Estimated Incremental Cos.ta of Phase III Investigation 

(1972 dollars) ; 

!• . Direct ?jabor , , / * . 

Project Direcijion and Data Analysis * 

1 Senior Princip^al Scientist 6 mm @ $2,5.00 $15,0.00 

1 Principal Scientist 6 mm @ 1,500 9,000 

* J. jqierical • ^ , 6 rtim/Q 750 4',50d ^ 

Suryey and. Testing <j * 

\ 300 children & $B0^ , 24,000 

' (includes coordination, training, coding » * 

* butrno paymeht' to family) 

•» * TOTAL DIRECT LABOR * $52,000 

2.- Overhead e l00% of Direct ' Lkbor * ' * 52,000 

. 4 > I ' . 

' 3. Travel 

'. ■• 72, trips @ %150 average ,.$10,800 
.360 per" di ems e.f.^S ' 9,000 



TOTAL -TRAVEL ' „ $ 19,800 



I- 



V\ " \>* ' 4k^' > Computer^ ^ Rental // * ^ 

:^ \ .20 houf^ @' ?42^ ' . , V . , , 9,500 

\ , .1 * • ' TOO^AL' DIRfiCl>^CQST, , ' . $133,300 ' 

•r r . 5, ' (Seneral and Administrative Expense ' , * • 

. V' '@15%:-Of Tot^l^ pirigct Co^t ' * ' 20,095 

. "" ' ■. TOTAL COST ■> • ■ ' " v ' . . , $153,395 



■ ' ■ ■ i.,: cv!?^- made , fat the elimination of 
•. : . ;Jhe^sboirt:.pa^^^ ..Th-is-wlll Be" somewhat offset 

, , ' ^^py the;vxn&^eased' p;erceh.tage'of^cQ6rdinataon time as fewer 
; =-3.:\;f^Hf'l<l|'en,,ar.!^,4i^^^^ on iriofe sites. ' • " ' 



• ' - •. ■ 



The* estimated cost of carfying^the study through 
all three phases i's then: 



Phase -I 
Phase II 
Phase III 



Total 



$163,;035 
169,073 
153,395 

$485,503 



The 'second phase study can be carried out within a 
•six-month period., It should be initiated witHin 2 
and*2 1/2 years of the Phase II data collection effort. 
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3.6- Simulation of the Non-Experimental Desig"k 



. In presenting the non--experimentaL design, descr^^bed 
in this section, attention was given. to the 'possible^^ \ 

'presence of sel-^-selection biases and" to the n^ed for. ? 
a sequential investigation which, could he terminated . 
if' intermediate results prove disappointing* These are 
worthy sentiments, but they are of little valpe as >f 
long as the effect of self- selegtion bias '.remains. ^ 

. lobs cure and as long as no weill-def iried rules exi.st'.f or 
discontinuing 6r redirecting the investigation on the ^ 
basis of data collected during the. first and second 
phases. To meet these needs, colnput,er' simulations of 
the entire design have been performed, and the results 
of these simulation runs have beeh used to detemine 
both the robustness of the design *with respect to; 
potential imjmrities ^nd/the'^riiles fpr ,.. the -conduct . 
of the three-pT^se investigation.' Thfe siijiuiatip^? . . 
described here provides not only importaint insights/ ' ^ 
into the operation of the. design, -but as a by-prod\:fct; , 
working computer progr^s for 'the analysis.. of .the real' / 
data as it becomes available:. '.^^ ' . 



The remainder of this sec,ti0n ^^^^^^^^^^^^^^ 
description of the way In . whicri^ S'lmt;^^^ 
generated and analyzed-, together, with/ the re s,u^ 
th3 analysis. In the diScUissiQn of the genetatipn ; . ' 
of simulated^ data, emphasis. Is/plabed... upon %b^ x(ie^t(ds\.\' 
used to simulate -environmentail/efd^ects ,a'nd self^Tsel.ectio^^ 
biases both between programs and^..abrbss tim^ th thife ' /. 
discussion of analysis, emphasis'- fs- plac?ed upon;"l;he ' ' ;/ 
(positive) payoff .of. finding enviirpninental effects , wh.en^; 
they 'really exist, and.' th|^ \(negative);. payof fs of fl'nciing . / 
effects when none' •.exist.. . T>e§e payoffs, together .with. . 
thfe estimated cost\pf -each phas^e/of the investigatiojiV ^ 
permit. optimization of the/desa^jwith respect t6 .the " * ^ 
critical values of the/test 'statistics. These values ^ 
provide the rules fpt/th.e .cpndtict of the. i^^ 
they constitute an.ihteg'rai. parfc/qf the. .design proposed. 
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* ' . ,Si^i^^^ tihree-f>Kase^^ consists 

^; ^ ; tepXic^^ .are\'^'a^.sig^,ed . , 

\yjt6 comblha:tidris bf faptdors .witihih -a .,j2^'; ''.fac^ - . ' ' 

jde sign ^ .j^herr-irM 

ai|tribut^.l6| to ~the ef£ec"6.bf''re^^ 

• %^.^f^^y \'Or^]to,.s^ between entering . 
>-^opuraViohs tsTQlf Tse^'leqtioh typie I)/ or; to^ exitiiig' .. . . .. \/ , 

^ * : . .popuratx^ II)/. : \l^he; siihiilat^ 

? ' , f ' , scores^ afedrawn .pr igirialiy., froin a. normal popUl.ation ' / , . 
1. . /- '/.:''-.:/ with }mean.iO0y'ahC'5ta^ ^ ' V.''^ 



Somuialfioh .gf ' Envlrdh m^tai - Impact . / ' - 
^ "\' . ■--"-•^^'i'^'" ' " '■•:'"''/■> • ' //>-"> ■ 
; ' / . Bnvirb^ impact is ch,araqteJt:ized ^a^^ 

V:;;/in.:t3i6i.:m^ of res^dents^- vs .:"flohrre^^^ 7 , 

^ J .attributable to program characteristics* ; Jin '..the ..d 
'7 s.l^fiitiDha^ phases of the investigation^ . this, is achieved , . \ 
; l^Jsimf?!^ adding an effect equal to .25% of the pbpuia-r/ . . ; 
./7/tibn st^^ deviat^bti^^ to the scores. o£\r^sidenj:s in ' 
:..iL7^elected progi^am classification. In' the .:longfi|:udi^ 7 7. 
piVa^se^ environmental effects, are slightly 'more cpmpiir^, . / . 
■'. cated^ involving modif ica'tion of the meran o£ the dis-*<* .. 
tributipn from which the. jsecond wave of 'obseWatipns . 
i? mad^l The subjects* s^corid wave score theui" ref lects ^. ^ 
both his first .wave score^/ the environmental/ effect 'o£ 
.the program, ^hd a random element. . • -^r^ '^7 vr'>' -- 

Simulation of Self-Selection Type^I (Inter-prograifti ) - ' J ^ 

Inter-'program se.lf-selfection'is; simulatfed-'irt^^ 
same fashion a§ environmental effects /except that 
^ ,:the changes are applied to residents.7.a^id noa-r.residents 
" ^aiike^ The .tests for self-^electiop' typ^ 

, , Twelve uniformly distributed; rattdpm.hxurtb aren 
'* vSUiMe4^7^l^^^^ this. sum approximates the 

_ homal diBtribCiliion with zero' ijiean. and unit variance* 



V,. 



-.1. 



62 



70 



'/within the first and second pha.se> 'of\.the\ihye^^^^ 

and both involve analysis o£ the nori--resider(t scoj^s^.';** 

Simulation of Self-Selection Type II (Inter-^'tempbraj ) 

This is the most complicated aspect /Qf .thB y^; ' 
.simulation experiment. Subjectis' probafiillty *6f/r: ./V ^ 
moving in a two-year interval . is .cprrelated with'*'hi's . . 
score. Thus the average proTDability' ofijinoving/^ 
modified either upwards of doWnv/ards accordii^g/tq///-* 
the subjects' developmental leVel.j By Vimtii'ati^^ ; 
* mobility in this way, the test/^fdr self-selection -/ . 
of the second kind involves, ^an^ily^is p.f variance - .y /jV 
a 2^, factorial design with une^ijal cell frequencies. ; 



= c. , • , * % 




3.6.2 Analysis of Simulation' Experiiyiehts > , ^ ' ",V'. V", /'-^ 

The basic outputs of the* simulairidn.' arer sets.' 6^ \ -.^/ ^V 
test statistics. These statistics 'will ^vajgy 
to the assumptions made (i.;e.*, environmeritalT'.i^^^ 
and no self -selection type j and 'no '>)iyi^pi^^ 
impact) and to some extent rarid'omly.. /',%he. t6s^^^ 
which are generated* in each run of the/sfimylatio^^^ 
all tests for main effects on program- variables; ahd^^^^^^ 

* residence; tests of family iricome /and '.race va^ 
are not gienerated. The test , sta^tisticy generated^ \ 

*as follows: ■ ' ' '^'--'^ ^.i' i^;^' s^^;^ 

Phase I : F^^^^ ;Tes t of Self-Seiec"ti6nr:T^^ • I ^; 

^12 ^* T^?^ ;.of Epyirpnmental Impact.' > i 



Phase II: 



Phase III: 



F^'t - Test, of ':S^lf-^Seiecti6n,vT.ype I 

" .^.ss of EnvifdrimentaTyli^^ i..., 
F^i.j^. - Test.- of Self rSelectipnVT,yp^^^ 
"F22' :-;:Test:' of.. Eayi-fpni^^^ \ : • 
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•C-. '-— : -.r -.v^- 'vaA4:;s/p'-:l'^"if ^.^^ each 

■ X'' iof \'tjiiiese .jbeXng- 'tr:^^ '"binafy''Variabies .f,->T$e test 

^u- .-.-^ww- forieach of 



1?;^-':/^^^^^^^ .9^ values .corresponding 

^r^UV f^"^; f»/;.tol^:'the^ siinul-ation will lead - 

:f'^r<^:.V sorne pf^'t^ rejection of 

;Fpr a'.^sefi^o^^^^^^ runs^ it is possible. 

Ijy-'^^^^^^^^ th'e'pi:obability (percentage of ^ the time), 

. >!! - ^ '^^^r^, pVirtiou^i^r'' hypotl^eS'f s will be accepted .or 

T . C'-'^'L tPiiusV in; the ca$e where there are no ^envir- 

;\.yj*,,.:: . effects but self-selecti6n of both kin^'s^ is 

. Vprese^^ it \^ould be possible -with lOO'or Sao" simulation 

/,rVv\ '\ ; r ^ r-' "^^^^ the« probability of concluding thaf 

/j..,.. ^ \ :i..renyl^ were present but there^ was no 

^ . r« ; S?^^^ these prot)abilities will vary .with the 

Vi' of the test, statistics • . • 

" ' The simulation experiment -tiow provides us with an 

v^;:^/ instrument for the selection of 'critical values, for this 
''VJ"; experimVnt. Tests carried out at/the 5%, level /tend, 
as was demonstrated in the discussion of sample sizes 
in Phase I, to ,be extreniely conservative ^ Although the 
null hypothesis is seldom rejected when true, it is , 
frequently accepted' when it is false.. The danger whidh 
"i thi'S creates is ^hat^of concluding' tba't no environmental 
effects exist on the basis of a tlest* which rejects the 
hy^othedis of effects' 40% of ' the time, evejti wheh they 
exist. To avoid €hls prcSblem, and to take advantage 
of thte sequential '.nature of the invesJ:igation proposed, 
the Simula tipn ha& beeo used to .generate rules for the 
. conduct of the ihvestdg^ation. . ; ' 
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„ 3.6.2.1 Rules and Payoffs, in the THree'^Phase . Study ' • , 



It is reasronable to-a^sxime that;,%ib Government*' § - 
sponsorship of this investigati»on rffc|ects an* interest ^ 
iri finding out whet)iei: .,pr not envirdMental change h^s ''^ ' 
an effect on chi^ld deveiopment. .iEf the investigation 
concludes that an effect exists r then.; the Gbvernment- 
may initiate, programs or policy to take advantage of ' - 
this knowledge. Jf environmental cha^ige does, in fact, 
have an effect/ these programs will te successful; / 
if environmental change' has no ef feat<^{cori^itrsrions 
wexe fals.e) the programs will fail. In th6 fir-st case 
positive net benefits wfll be realiized; in the second ' - 
case, money will be wasted. The investigation may^ * - 
of course, conclude that no effects exist in which case * 
no new programs will be initiated; under these circum- 
stances, and regardless of whether or not e'ffects really.- 
exist, there will be no benefits and rio costs'. These • 
payoffs are summarized ^in Table 11. >In this^ table, ; 
B denotes the benefits of . programs designed to * take/- 
advantage of environmeiital change efte^ts^ fxid: C denotes 
• their cost. It is 're.aspftable' to assume that B-C is 
. positive. " • 

It is now pos^ble to express the expected ^value 
of the three-phase investigation in terms of these 
payoffs, and ei^ected cost of conducting the study (K) . 
Denoting this^^^pe.eted value by^ V, we :have 

A :/ . ' - 

V = Prob^'^CEf ^ect foui?d and' no effect exists) 

. -C Prob (Effect found and no effect exists) 

^ , We nd^:4efii^^ ' 
in . terms of th^ t.es-^/'statisjbiQS^^^ ^ Dferib.ting .^ith asteti^ks.- ' 
the criti^eal values' of ".Irbe 'tes^ :totlstics,' an' ^Cfect- 
; is s^id to be f p.Q^id,. if '; jaOLl the fplj^Wiiigf-' ineijuai^^^ 
* 'are 'satisjfied':. " ''V'^- '"'■;>•''■ / ^ " v ; -.v,/":":— . 



V 



''^.^ Phase. 1 ^iil^ii No 'self-selection type I 



^12^^12 Effect exists 

y ' y ' , 

.X Phase ll' ^21-^21 ' • No ■ self-selection type I- 

'i-f ' ^22^^22 Effect exists - / j: 

.'■ /phase III F3j^£F3^ No self-selection type it 

, ^32^^32 Effect exists < 



If any one of these inequalitie.s is not satisfied, the 
investigation should^be terminated; clearly there is-no 
benefit to be achieved by continuing and a further 
phase of the investigation will only cost jnor^e money. 



^ The rules of the investigation are now defined 
except .for the choice of ^criti^al values for the 
te^t statistics. This choice is now'^erformed by f ' ' 
finding those critical values which maximize y. *'in 
carrying out. this xnaximizatlion, all eight possible ^ 
combinations of effect and self-selection were , assumed 
to be equally likely to obtain. The expected cdsts^ 
of the investigation itself (K) is computed as simply 
the* cost of each phase, times the probability of under- 
taking that phase'. 
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3.6 ••2.2 Optimization Results 

Separate optimization runs for 6, 9^ and 12 
replicates -have been performed; these ' correspond 
respectively to the designed levels of. replication 
for high-school, pre-schc?ol, and elementary school 
subjects. ,^In each case, the benefits of finding an 
effect when one exists were assumed to be- §20 
million. The costs required to .realize these benefits 
v/ere assumed to be $10 million. At some jadditional 
expense, i^ would be possible to investigate the 
sensitivity of the results to alternative benefit 
and cost assumptions. As already mentioned, eight 
alternative combinations of effects and self- 
selection types, all assumed equally likely, were 
u^ed to generate simulated tests statistics. Ih , 
only 12.5% of the runs, therefore, were effects, 
present without any form of impurity. In view of--' 
this, the> re.sullis aXe extremely encouraing. 

It is useful to consider^ the results as 
providing two kinds of informatibn. In the first 
place, for each level of replication, optimal 
values of the te^t statistics in each phase are 
found. These are presented in Table 12^ In the 
second place,, for each level of replication, the 
power of the investigation to discriminate between 
alternative hypotheses and its probabi-iity of termina- 
ting at each phase are found. Those results are 
presented in Table 13. 

It is interesting to npte several aspects of 
these findings. In the first place, it is never . 
proper /to terminate the investigation for absence 
of effect in the first two. phases of the stu4y. . 
This reflects the added power of discrimination which 
the longitudinal design- provides. It is, however, 
possible to terminate the design because of self- 
selection effects. As the number of replicates 
increases, the critical values also increase; since 
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ifV-' rc \ ; " . r '^^iV^ .'V V' : - ^'^'^^'-V^y -l^i^ 

is true even for the self-selection eff§ci;V,/!:th4'- '.^-^yV"^ '•^>5:*i" 
feu. '''^'^'."r^C-i^ power iff. the longitudinal .phase must, be quite siii^'itivV - - "* 

Is second way 6f looking at th.ese results iiiyoly^s. 

I'v thf^ that the experiment wilP.^i^d' ari; 

K^^^^^^^^ one^ exists vs. the probability' th-a-tL> • . , " 

I^f; effect when one , does not exist, , q^iese A!k/ . . -^V/' 

1 -^U ..'-fc^f^ together fe'ummarUze the power'^of the 'design*, ..." 

presence of self;^^selection"bias of . . 

' ^ * :^!l?P^h^.^irids,t to discriminate between the primary hypotheses; 

re^ together with the probabilities of stopping^ 

r'^'atf/eadft'phjaseiT are presented dn Table 13, ' ' v* "1 



'-v.* / * ' " > .7 , ■ f ^ 
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CHAPTER F,OUR , . , . ^ v - V-* ' 

EXPERIMEtlTAL PESIGNS FOR HOUSING PROGRAM IMPACT ' * 

• . ' vf^* ' X > 

The nori^eJcp^rimental investigation .proposed iii* 
Section 3 is vulnerable to impurities^ ojE twO;.kindj lin . 
the first place there is the dariger of sdlf^'selection 
or self-assignment of subjects"^ both between* programs 
and aqross^ time;' in the second place there .is the danger . 
that the. variables which characterize the housing 
tr.datm^nts are not adequately controlled. If either or 
both of these impurities are .present, significant tjreat*- 
ment effects may reflect either differences between the 
subject populations, or the ommission of influential 
variables. In either case, the value of the investi- 
gation is severely compromised. Awareness of these 
pitfalls Jias prompted the investigation of truly^ 
experimental approaches to the design of this study* 



In attempting to meet the requirements of an ideal 
experiment -dn tl^e ^context of this study, certain 
difficulties .arise immediately. In the first place, 
the random assignment of subjects to housing treatments 
requires* a^ ma jqr cpmmijttment of funds, -however^ it is 
to be '"'accomplished.,' 10n practical grounds al6ne/ it is 
n^t reasonable to expect that short-term undertakings 
to subsidize families. livj^g.in selected housing environments 
will be effective, lil the second place, ^the housing, 
treatments thems el ves/^an never provide,! the ^ure contra^sts 
of the labo'ra'toty , since the controlled variation, of ^ 
the vari^ables of interest can never be entirely indepen- 
dent of uncontrolledV variation in others, such as schools, 
health c'are, local uriemployment, ^and so on. -Two experi- 
mental approaches to ^}is investigation have been 
explored. Each of thei^e approaches gpes.some way, toward 
the removal ojE' one — but] not Bofcb of these difficulties. 

* • " 'V * * 

The fitst alternative to be considered has signi- 
ficant- advantages ' in .terms of cdst, but provides only 
limited insight into .th,e. dimensions of environmental ] 
impact. This is the housing allowance experiment which 
the U.S. Department of Housing and Urban Development is 



.proposing to irnplem6nt. , The incremental cost of piggy^ 
backing'. 6n to; this' experiment is ^ qui t^ small^ but 
i^jscause ^of , the way in whijsh* fehe project xs designed, 
its y^lue is, i^omewhat fjeri'phpral ,jto thi^' stu^yV- jThe y. 
second altern^tiy^f which is --the. most powerf ul.^ 4esign , 
ot all tiiose proposed^ is also, by far . the most' expensive 
.T|ie,^6niy real., way: to* achieve both planned' combinations 
or housing conditions and randpm assignmeiift^ of: subjects 
is to biiild the prbgrams- and to manage .ajainissiohs. . . 
.By selecting loaaticyis to rembye unintended local* ^ 
variations iri^ unemployment,,^ school;, quality.^ supportive 
services- ^nd^ so on,, it wiXl'be .possible, to- achieve 
iftuch. purer, contrasts ^between prpgratns than is, pqssible 
with existing facilities* Suppoift^ from ::agencies ^ ' ^. 
interested^ in otlier ..diniension^ of environmental impact 
may defray SLome of- th*e costs ""of this approach, but^dt . 
'Wfilrl' .n*ever be'^ chfeap. ' • * 



These .experimental approaches are seen ais backups 
to; the thrfee phase. nohre^perimprital investigation, 
outlined in the'" preceding ^section. As will become 
clear, a, valid non-experimental ihveatigation ;will . 
provide more ihfo'rmation than, the H9vising 'Allowance . 
.experiment at a cos£ which is ""roughiy equivalent; 
itr ^wiJ.1 provide almost as much as a fuXl-blown experi- 
ment at "4. considerably redu'ced cost.. Only if the 
^nSn-fexperimental designs fail- to meet the necessary 
crit^erra of* validity, should they be abandoned Jyin favor 
of tne designs which fpllpw.. -'^ . * /'^ 
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4 • 1 • The Housing Allowance ^Experiment 



The-' U.S. Department . of Housingv arid Urban Development* 
is purrentJ-X planning to' conduct^, a major housing allowance 
experiment} 'present plans call for the^exp*eriraent/|o be 
conducted- oj]! nine sites with ^ 60{y householas on each site 
selected to receive payments and* ah- additiy6nai\ 400 ^ \ ♦ 
households per sit6r to serve as contarols.^ Payrajents to 
f amiliefe will be geared tP an exj^erimental plan involving ! 
both family income, and the xen tail, payment. The principa^l • 
objective of the experiment' is to relate patterns /of 
housing mobility to the structure .-of treatments called . 
for in the design. .-\. ^ * ' 

> • ■ ■. . - - . 

This experiment clearly provides an opportunity to 
investigate the relationships between housing and loca-- 
tional change^on the one hand, an.d measure? of child , 
development on the other. . It is .important. to emphasize.//, 
however, that tHfe inclusion of child development measures 
in the context of this, experiment will l^.ad. to, h^pot^eses * 
which are qualitatively different from those which, the 
Non-Experimental -"^Approach is -de^i^ned to -test. "The 
Housing iVllowance Experiment differs from the Ndn- 
Experimental Approach in that its emphasis is primarily 
upon locational change within bqth. public and^, private* 
sectors of the housing market rather than upon relocation ^ 
into public housing'. Other things being equal, 'this / . " 
makes it generally more interesting than designs developed 
exclusively for public housing programs ./ Other things 
are not equal, however, and as will become clear ^ the 
Housing Allowance Experiment is not a partici^lafly , pro- 
mising vehicle for this investigation. To. understand 
why this is so, it is necessary to examine the design 
pf this experiment in some detail. * 



The housing allowance experimental design calls * 
for the experimental group to be assigned to ten basic 
treatments. These treatments involve different payment 
formulae , cost standards , contribution. rates , and 
earmarking methods. There is, in addition, a control 



^Not all these families will ha ve^ children, naturally- 
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group which will re^ieive no allowance; Special fir ^vision 
of information on housing, opportunities may he provided 
to some^ 'but not all^ of the ^xpermental group. 

. The basic objectives of 3^^housing^ experiment cannot 
be* realized unless there Is some variation in the response 
of the different groups "to alternative Tevels and cpmbina-- 
tion^s of allowance. To , this extent there is a coincidence 
of interest between the primary objectives of ^-this study 
and 'the secpndary (or child development objectives*), 
fiere^thfe coincidence- ends, the objectives of the ^primary 
study relate to the -response of individual housing 
choice to alternative' combinfitions of incentives;* the 
objectives of child develqpment study on the other hand, 

^ relate to , the response' of child development to the 
Induced housing change and not to the incentives which 
bring the change about T The outcome measures are, ' ^ 
th^efore, once removed from the actual treatments * ' 

"adnflLnistered; intervening between treatment and; outcome 
is the family's choice amongst the available housing 
alternatives; this is just the self-selectiyemechanism ' 
which the^^experimental approach is desigiied to avoid. 

The * implications of Ith^s are^ clear. It is not * / 
possible, despite the appearance of experimental assign"- » 
ment, to attribute' observed developmental gains to the 
housing change of the fairfily; within the. treatment groups 
both housing change and child development will be jointly 
determined by the individual characteristics of the family; 
statistical association between the two cannot be given 
a , causal interpretation. This problem would not arise if 
^families were assigned directly into different types of 
housing,' as in t^^e 'second of the experimental designs 
proposed. , r> ' ' . ' . ^ ^ 

4.1.1 Desi'gh and Analysis in the Housing Allowance Experi- 
ment. ' ^ , / ' ^ 

— ^ > . . 

The self-seleption problems of the Hbu^ng Allowance 
Experiment jcan be avoided if the attempt to associate 



4evelj)pmental gains with the' ljidivraual'S' hojasiny choice 
is abandoned • Instead the .analysis is ^directed' toward ' 
■ the comparative impact oY/^ddff firent. allowance schemes 
on the , child and f amily. variaHle^ of interest.' If sig- *, 
nificant differences betj^dferi ^treatments v'ar^ detected, 
' '\ it may then .bfe possip\& to* "e^^plaiii"^ ^these dij^ferences. 

• . by, reference to the' jnea.n Changes in housiAg" and in * • - 
disposable income for each treatment, group. , ' . - * ' 
\- * . * . ^ ' • « ' ' 

^ • • . . , " ^ • . . e ^ 

^ ' It is useful to begin by. considering .the relationship . 

.between a ^selected child de\?elopment variable and'^the 
indep'endfent variables of housing ar^d disposable income. '* 
^. 'Denoting the ijieasured gain of the i^h child ars signed to 
the ktn* treatment by Axik, we \can conjecture the 
existence of a linear relationship between this* gain on ' 
^ the* one 'hand,.- and^' changes in the family's housing 
> ^ (Ahi)^) and disposable income .(Ayj[j^) , on the other: 

* ^ », i 

4 , ' ' • ^ ' 

\ ^ ^ik denotes measurement error, and the gain may be** ' 

defined either as relative to" baseline measurements "or ' . ^ *' 
feo^the control group me&n. Notice tha-t the cpefficents . ' ' • 

of the independent variables are ^perroitted to vary acrpss 
. individuals. - * / ^ \ * 

By taking expectations over individuals, equation - * *" ' 
' . ■ ■ - -(4.1) can be written: , ./ ■ • " • - < ^ . ••, ,^ 

/ • ' ■ ■ ^ ^ ' . ^ ■ 

' * * k * ♦ • • 

' / ^{t^^) . ^ OLi^fy. + 3\K"j^ + cbv{a^Ay£j^} > ; ' ■ ^ '* 

" / '' + CovCB.Ah.,} ' C4.2) . 
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a and 3 now denote the mean response bf the dependent 
variable to changes ^ in disposable income and housing 
respectively; they are the unknowns of interesjc, 
yj^" and h^ denote respectively, the average changes 
in disposable income and housing for the k^^ treatment 
group. ' , 



^ ^ This equation can only be estimated if^ the covar^iaiice 
terms are the same' for each treatment group — or if their 
variatioiv^can be represented by .some simple expression. 
The cdvanance term measures the degree of association ^ 
between the .responsiveness of 'the child development 
measure to housing choice, and the responsiveness of 
, housing choice to the experimental i^icentives provided.. 
*Thus^ if ,f ami Ides/ who choose more housing Improvement 
•than' the average of their- group have children whqse 
response J:o ;hQV(sing improvement is also above the 
average, ''J:he covariance term will be -positive. ^ 

* « ■% 

'lUnfortunately it is not reasonable to as^sume that 
'the dtovariance terms will'^be constant for each treatment 
group. . Consider the simplest form of subsidy system 
i'n whith a. lump sum payment', varying ^ across treatment 
groups, /ii^ mad6. Let -Z]^ denote th6 rate of subsidy 
to the k^h ^roup, and let . Yi denote* the- fraction 
of vthe subsidy spent on Rousing by the i^*^ individual; 
it is c^ssumied that Yi*-^oes not vary*v?ith the level of 
th.e feubsidy.. Defining 'housing chang.e In terms of expen- 
diture^ this gives:, ' \ » - '* 



The 'coyariance^ tefnis of' irtter^s t-' oan then t>e written: 

' "ilk % Tt|| ' . • , « y . y 



In this simple ins-tjancef * thg qovariance/^i-s proportional 
£o the rate of subsidy and.Vill v-ary across treatments; 
it, would nevertheless be single to adjust for.'^^su^h 
variation by normaldzation,, A similar normalization ^ ^ 
could be' carried out in ^the-. context of the pr6ppsed 
Housing Allowance Experiment^ although the iftiplicit 
behavioral ^as-sumptions remain obscure. The total ^ 
income change resulting from participation in the 
experiment can be separated into two effects — a change 
in 'dispoa^ble incOme> defined -as increased pijfirohasing 
pov/er over poxi*-^ housing, goods , and a change 4.n housifigr 
defined as the increased e^cpenditure on housing-. 
Trdatmen^t groups will diffter amongst each 'Other with 
respect to the total income change ahd with respect to • 
its 'breakdown between housing and non-housing expendi- 
tures. "Normalization" can then be carried out by dividing 
bo^h sides of the equation (4.2) by .the- total income 
.change: . , : - ' . ' . 

■ ^ . , , • (^i^sL, ■ V ;^ '(-as-, c,, -(4. 3,- 
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Jhe .cqnstant a' corresponds, .to' the cbvariance terms, of 
equation ^ (4.2) ^ which, now being "noirmalized/* are not 
expected to. vary 'between treatment groups. The dependent 
variable is now the rate- of change of the' (development) 
variable with respect to changes^ in income; the equation^ 
can be interpreted as ^ saying that' the rate of change of^ 
ifhe d^evelopment variabl'e with resp&t to .income depends - 
6n .the way in which gains, in income are allocated Hetween 
housing and- othet expendittires'; Incidentally , .normali'- 
zation can be justified on ground^ relating to th^ .distrif 
bution of the error term; which would; otherwise' tend to 
be heteroscedastic. /^^ * 

The equation cann'ot,, ,9'f course/ be estimated in ; 
this form. because normaliza.tipn reduces the dimensions 
of independent variation %o one.^ If we. denote the mean . 



percentage, of -4ihe ihepeas'^ ixi ijicome for the 
grov/th' which is- spent on housing by - p^ ^{A.SY can 
be written as: * , \ ' \ 



. or more simply: 



Th6 hypothesis that housing change .influences child 
'developnjent, . ovef and above the effect of income ^ change r 
can now^ be investigated through tests on the .coef f icent 
b^l Rejection of the null hypothesis that ' b^ is zero 
is equivalent to a finding ^that housing change has an 
independent (and "beneficial) effect 6n child developitient . 

.'4.1*2 Sample Sizes and "Confidence Level^^ 



V , A j5Qssible appl^icatior^ of simple regression analysis 
to th^ relationship betv/een child'^ development and housing 
expenditures Kaa been presented in the previous section. 
ThiW.approach, while extremely' limit^ed in .Its scope, , 
apJ^ears t6. avoid. most of the problems "of -infepence which^ 

.result from self-assigmhent of families .to housing within 
the treatment g'roups.- In weighing the advantages $nd 
disadvantages 'pf €his approach.,, however, consideration 

,must also /be given 'to' .the' cpnfidence levels vrtiic^;i "mi^ht 
be;attain'ed and the 'saftijJle sl^es which should be required 

.tp^tta'in them. ' ' . ' ' ^ / ^ " . 

< * , **** ' . ' ' ' 

* t - ^ V - - ^ - 

-'The most convenient way to Approach this ptobleta 
is through th^. length of th^* copfi-dence interval lot b^; 
the lOOCl-a) -percent* i'nteryaj.'- f or "b^^ is gj^ven. by:' 



wh^re denotes the;' .critical value- or the students 

t distrioutioh, and where -h^ and ^ - denote .the .least 
..squates estimates* of 'b^'* and the standard 6rror of 
estimate respectively/. Convenient rules 'of thumb for 
this purpose might be to require the^- length o^ this inter- 
val on Qne -side to be less tKan 5 . 10"^ and less than 
2 X 10"3. ^(Tfliese would correspond, for every $1000 
of income -spent exclusively on housing, to 5 and 2 point 
gains on a sckl.e wjlth population stand4rd deviation of 2,0) . 
The Pi's "correspond to the mean 'fraction of incremental 
income^ spent on ^housing for each of Ithe treatment 
(and control) groups. Evidently the larger the variation 
of thev pi^s tXe smaller will' be the required sample 
size. Unfortunately these cannot be known in advance of 
the actual experiment. Table 17 provided required sample 
sizes for ' confidence intervals of this length for alter- 
native values of 2pi^. In each case," a single-wave 
study is contemplated with mean scores, rather than 
gains, compared between treatment groups. The error 
variance is given. by the population variance of the measure 
divided by the number of observations in each treatment 
group (i.e^. , the variance of the sample means of th,e - 
treatment, groups) . It is assumed that 11 observations 
are available (10 treatment groups plus one control group). 

' These calculations are not par^^icularly encouraging. 
In the worst case, where there is only limited variation 
between- groups with respect to housing choice and where 
the ond directional confidence interval spans only 10 per- 
cent of the standard deviation of the measure, the experi- ; 
ment would require over 50,000 observations.' In the event 
that the allowance^ lead to quite wide variation in the 
choice between housing and other income (Spi ^ 0.5), 
a 5 point interval would require around 2000 observations. 

. These calculai:ions have been deliberately^ restricted 
to dependent variables based on single observations on 
families and children. The required sample sizes^ could 
be .reduced if, instead, differences between baseline and 
, subsequent measurements were 'used (since test-retest 
correlations will offset the need to make two observations 
on each child) . , • ' ' , , - 



V iiength of 
\conf idence 

^interval 
11 X 


5 X 10"^ 


2 X lO"'^ 


0.10 


820 


5000 


' 0.25 


330 


2000 


0.50 


165 


'10 DO 



Table 14* 

Required Sample Sizes* (observations per 
treatment g^-oup) for alternative 95% confidence 
- intervals and alternatives Ep.^'s, 
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If this strategy'were follo^veSf however/ it wbulS be 
impossible to know whether the- variation in the indepen- 
dent variable p| will be sufficient to make* reliable 
inferences, in advance of the baseline survey. For 
this reason, a longitudinal approach is not recommended 
for the Housing Allowance alternative. 

Considerations similar to those v/hich lead to 
rejection of a longitudinal approach suggest that a 
single-wave cross-sectional analysis should not be unjjer- 
taken until it becomes .clear that adequate variation in 
*the independent variables exists. Furthermore, by 
waiting to find out the magnitude of the effect of the ^ 
allowance scheme on family housing divisions,- it is « 
possible to leave more time for the putative effects 
on child development to take place-*-and this in turn 
will permit the use of less rigorous tests* for signifi- 
cance. , ' ' ■ • V 

^ '0 

I 

4.1.3 The Housing Allowance Experiement as> a Vehicle 

„ for the Investigation of Housing/Child Development 
Interaction — Summary . 

It has been demons tr^te'd that the Housing Allowance 
Experiment does not lend itself readily to the purposes 
of this study. 'Families are assigned experimentally 
not to planned combinations^ of housing, but to planned 
combinations of incentives; the intervening response 
ofyfamilies constitutes . a self-se*JLecl,ive mechanism "whicH 
largely elimin^ateg the desirable fexperimental aspects " 
of the design--at least, for the purpose*^ of this study. 

A partial solution to this problem^ can be found 
by aggregating across treatment groups and perfom^ng 
a' simple lineai'r regression of the 'child* development 
variables of interest ^on the mean percent of family 
inc6me spent on housing. This approach is, itself, 
somewhat tainted by- aggregation' problems and, in any 
case, it pr'ovides np insight into which dimensions of 
housing quality are influential in .determining the rate 

\ .82 - ^ 



of child. development. Furthermore, unless the differen- 
3tial incentives of the allowance scheme are powerful^ 
enough to provide- a wide range of response in terms 
of housing choice, the sampling variance^ of the lea;5t- 
squares estimates will be. unacceptably high. 



This approach, nevertheless, provides. a. useful 
back-up to the non-experimental study. If the non- 
exper.iment4l study fails by reason of self-selection 
the only alternative will be an experimental approach 
of one Jcind or another. The Housing Allowance Experi- 
ment provides an opportunity to take advantage of an 
existing study at, at least relatively, to other experi- 
mental designs, a reasonable cost. 



One pre-condition is necessary if this approach is 
^.,s^s4f)le, This condition is the success of the 
Ing Allowance Experiment in achieving significant 
vtf!M*ation between treatment groups with respect to 
their housing choices, and in particular with respect 
to the extent to which housing allowances are used to- 
upgrade as opposed to the extent to which they ^are simply 
a subsidy to existing rental payments. Depending 
on the extend^ of 'this variation and this will be readily 
available when * the ^experiment l^as been operational 
for a year, it will be possible to estimate required sample 
sizes and costs, and to make a' decision to collect ^ 
data^ in the second or third year of the experiment. To 
wait longer would be to ruh into problems of attrition, 
to be less patien't wduld .provide inadequate, time for the 
effects of environmental jchange to work themselves out. 
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4.2 Alternative Experim ental Designs 

. As a vehicle fbt tl\e investigatioi} of the relation- 
ship between child development and the' ht^usi^ig enyiron- 
ment, the Housing Allowance Experiment has been shown to 
be unsatisfactory. The ^^rincipal reason for this find- 
ing was the lack of an experimentally accurate mechanism 
for assigning families to housing^ typ^ . -Attemptife. to - 
avoid this difficulty lead to secondary difficulties; in 
particular, the need to collapse the characterization of 
housing change into one dimension is part;icularly unde- 
sirable* in the context of this ^tudy.. Those problems 
naturally suggest the possible development of alternative 
experimental approaches in which the child/housing devel*- 
opment investigation Would be the primary, and not the 
secondary purpose of the study. 

' To achieve a better approximation to the pjroperlbies 
of an ideal experiment, , two Elements are required^ In 
the first place, there is a 'need to insure that subjects 
are randomly assigned to alternative treatments. In the 
second place,. the treatments themselves should j:epresen|: 
planned combinations of- the variables 6f interest in 
which there is na confounding of independent variables 
either with each other, or with variables excluded from 
the design. Both considerations suggest the desirability 
of conductj^ng the/ experiment in- a limited geographical, 
area (thisr area could of co.urse constitute a singld 
block in a larger expe^iiment) ; in tHis way it is possible 
to avoid confounding housing'-vajriables with regional dif- 
ferences, and an^it is also possible to' attempt randon 
, assignment of individuals to housing • jbreatments when the 
separating distance between alternkive treatments is not 
large. *The design of the experiment ib now condidered 
within the' constraints imposed by iimitation^of the .ex- 
periment to an area small en<lu^h to attemptlrandom as- 
signment, of families to alternative housing ^programs . 
. # • ^ . * 

K . ' 
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4;2'*1 Methods pf> Subject Assignment 

The need* to. assign subjects at randopfi to 'al'fgrnative 
housing projects places severe constraints on thi^s exper- 
im'ent^ In the first place, subject families must per- 
ceive all trie \ housing opportunities provided by this ex—^ 
periment.as preferable to other availai?le ' private or pub- 
lic hpusing (including their presjent location) % ' If ^. this 
condition is not met, families will not agree* to- en:^er . 
their assigned projects — c^r will only agree if they/^re 
assigned to preferred alternatives; this would then re- ' 
create the self-seLection problem in an experimental 
'setting • In practice, this may be* a hard c^ondition to 
meet, particularly ;Ln vie\^. of the planned, variations in 
the environmental quality of the treatments themselves. 



' , There are sev.eral ways o^ attempting to insure that 
the acceptance rate of assignments is adequate. In the ^ 
^first placed as already mentioned,' the treatments must *' 
be locafted .in reasonable proximity €^ one another, and 
all mu^it have adequate transportation access, rf the 
incremental costs* a^ssopiat fed witi^^ tr^anspbrtation to and 
from the assigned housing treatanent exceed the dollar 
V'alue of the improved housing quality, it is-,rat.ional 
behavior for the* family -to decline the assignment. A se- 
cond method" of insuring a high acceptance rate would in- 
volve screening applicants to determine their willingness 
to move into. .any of the experimental; projects. Two po- 
tential -dif f iaalties are associated with auch a screen- 
ing process; firstly, families may not give reliable 
answers in part because of the hypothetical tiature of 
the question, and in part because they wish to retain 
the opportynity to move into one or' more of, the desirable 
projects; « secondly, the proces.s of screening further*re- 
duces the generalizability of the findings to that lim-- 
ited group of subjects for whom any of. thg alternatives 
are preferred. This can only really be overcome if some - 
effort is made to insure that -relocation in±p even the 
least desirable alternative is still acceptabel to a ^sig- 
nificant percentage pf the population of interest*. Efr 
forts to insure the general acceptability of all the al- 
ternative treatments may, in addition, include some form 



•of special payment over and above the standard rent sup- 
plement. To the extent thatv associated real income chang 
exercises 'its o\m independent effect on the dependent 
variables of interest, however, .problems of inference 
will be correspondingly complicated. 



The selection and assignment of experimental fami- 
lies to hdusing treatments cannot be discussed v;ithout 
some reference to the possible use of control families. 
If the experimental design calls for comparisons of mea- 
sured development in fainilies assigned to selected hou- 
sing programs vs. families not assignisd, it would be ne- 
cessary to select from amoungst applicants a set who 
would be denied admission to any of the experimental 
programs. In the context of a longitudinal design, .some 
means for insuring their continued participation will 
then be required. 
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"4>r2/2- - -Desl-gn of Experimental Programs 



The conduct of a truly experimental study provides 
an opportujiity to achieve a ^auch ^ sharper contrast between 
alternative housing environments t^an is possible in a 
non-experimental setting. The non-experimental approach 
limits the investigation to a contrast between available 
housing environments, and this necessarily leads ta some 
confounding between included and excluded variables. In, - 
the experimental setting oh the other hand, the freedom 
exists to match experimental programs almost exactly on 
physical characteristics, and to a lesser degree, to 
match them on excluded school and neighborhood variables. 
In the latter case, the freedom is less than absolute, 
since once again the experimienter is forced to work withr 
in the constraints fo wifet exists. It is not realistic, 
for example, to build and populate new neighborhoods for 
the purpose of this ^perimentl 

The number of expierimental programs to be included 
in a design of this kinS will depend upon the nuiriber of 
dimensions of interest. Consistency with the objectives 
expressed in the non-experimental design would be, achieved 
by hiaving four programs distinguished from one another 
in terms of the socio-economic characteristics of 
the neighborhood and mix of income within the project. 
Thus two of the programs should be located in high-income 
ne.ighborhoods and* two in low-income neighborhoods; with- 
in each of these pairs, there should be one project wi^th 
a high percentage of moderate income families and one 
project with very few moderate income families. Attempts 
to achieve further distinction .between programs on ,vari- 
ables such as school "quality" or ethnic mix do not ap- 
pear to offer much promise of success, given the neces- 
,sity to live within the. constraints of proximity and ex- 
isting neighborhoods. . . 

The exclusion of physical characteristics of the 
housing fppm the .independent variables of interest sug- 
gests that each of the foUr projects should be similar in 
their design. Futhermore, since the size of the project 
, is not in itself of intrinsic interest, the number of 



units to be built should be determined on statistical 
grounds. In two of the programs, half the resident pop- 
ulation should be moderate income families, and there- 
fore not experimental subjects. The programs should be 
at least the size'' required to house an adequate subject 
population. If adequate is defined in terms of the sam- 
ple sizes required in the non-experimental design and 
allowing for some attrition, this would require each 
project to contain between 125 and 175 units. 
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4.2*3 Costs and Conduct of the Experimental Alternative 

Tbe experimental alternative should be conducted . 
as a longitudinal investigation / wii:h ^ne. survey wave 
performed prior to admission and one siibsequent wave 
after a pierod of around three years. Test for signi- 
ficant differences in mean gains are then carried, out . 
exactly as in the third phase of the non-experimental 
investigation. Because of randomization in assignment, 
checks for self-selection at the time of the first wave 
are redundant. Checks for self -selection amongst exiting 
populations (which may be larger in the l^ss 'desirable 
projects), should still be carried out. 

In attempting to arrive at an estimate of the costs 
^of this alternative, it is worth emphasizing that the afetual^ 
"costs of iT^easureinent and data analysis remain essentially 
unaffected. The real cost elements relate to the construc- 
tion and maintenance* of the projects and ^ to the possible^ 
subsidization required to insure stability and absenpe 
of self -selection amongst the residerjt populations. The 
construction and maintenance' costs should only be charged 
in total to the experiment if the programs possess, no 
social value over and above the r.esults of the experiment. 
This is clearly not true. At a minimum, the social value 
, of the projects must equal the discounted value of future 
' rental payments, leaving- the real cost of the ebcperiment 
to be determined by the discounted stream of rent supple- 
ments. This is probably a somewhat exaggerated estimate 
of the costs* of the experiment, because to the extent that ^ 
the resources used to develop the experimental projects 
were applied to an alternative development elsewhere, similar 
rent supplement charges would be incurred. Any way to 
assess the, opportunity costs of this experiment are by 
nature arbitrary, but if a relatively high estimate of 
around $40/month per family is used, the undiscounted 
housing costs of the experiment would be a'rbund $1,500, .000 
over a period of five years,*^ five years might be an a^5erage 



$40.00, a- month is the estimated interest subsidy for 235 . 
and 236 programs for a family of 5 paying an average annual 
rent o£ $960. "Improving Federal Housing Subsidies: Summary. 
Report," Bernard J. Frieden. Paper submitted to Subcommittee 
on Housing Panels, Part 2, Committee on Bankj.ng and Currency, 
House "of Representatives, June 1971. ' 
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length of resi4ence for experimental families ♦ To this 
should be added costs for survey design and administration 
of around $500,000, for a total cost of $2,000,000. It is 
this cost which makes the experimental approach Tess 
desirable. 



There is, of course, an additional reason for 
exercising caution with respect to demonstration programs 
of this kind. The experimental programs contemplated 
involve the construction of medium-sized low-income 
housing .projects in middle and upper income communities. 
Even when such projects are sponsored within communities 
of this kind, effective community opposition is almost 
invariably forthcoming; when the project is sponsored 
outside the community and the basic design and location 
decisions reflect research interests, the likelihood of 
obtaining community support in any suitable location may 
be extremely small. These considerations, only touched 
.on here, suggest that an experimental project may ^be 
infeasible, as well, as expensive. 
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-4-i2.4 Alter native Experimental Approaches - Summary 



Truly experimental approaches to this investigation 
which involve site-selection, design and construction 
of new housing projects, together with randomized 
admission procedures, are conceptually possible, and 
possess desirable properties from the viewpoint of 
statistical inference. They do, however, possess severe 
practical drawbacks*' In the first •place, satisfactory 
admission procedures may require payments to families 
over and above the basic rent subsidy for publicly 
supported- housing. Secondly, ^ even with expensive^ ad- 
mission procedures, there will be some confounding of 
included neighborhood variablels with omitted neighborhood 
variables and some self-seleqtion amongst subjects.. The 
experiment would .not. only cost! about five times as much 
a .a .comparable non-experimeptal approach, but its f eaisi- 
bility is quite problematical. \Fdr these reasons,* this 
approach appears to be rather unpromising. , . ^ 
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CHAPTER FIVE 



MEASUREMENT 



The study of the effects of envirorunental change 
on children and their families relocating into new 
housing and new neighborhoods is broader in scope than 
studies of *more limited intervention, and presents- 
greater problems in isolating and controlling variables. 
If these obstacles can be effectively overcome r however 
this study presents an opportunity, through its very 
broadness, to maJce further differentiations between the 
dimensions of child development' and their response to 
environmental change. For these reasons,, an attempt 
has been made to developlas compreliensive a battery of 
instruments as ,the constraints of time and cost allow. 



The basic criteria applied to the solution of 
instruments can be summarized as follows: 



(1) , Is the area of child development measured by 
this instrument one which could reasonably be expected 
to be affected by the described environmental changes; 
is it reasonable to expect that developmental gains in 
this area will become precursors of adequate adult 
functioning? 

(2) Has this test been subjected to adequate 
validity 'and reliability testing and do, norms exist for 
both middle .and low income children? Furthermore, is 
this instrument being used for the . longitudinal evalu- 
ation of children so that useful^'epmparisons can be made? 

(3) Can this test be accomodated within a battery 
which^, Satisfies reasonable constraints in terms of time 
and .cpst of administration? 

These criteria have been applied to the selection 
of , |i]rstruments for children in three separate age 
catpi^^ries. These categories effectively correspond 
to ^Ejre-school, elementary school, and high school age 

}i ■ ■ ■ 
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ranges. ""ns^sures of change in parental attitudes and 
family situl^tion are obtained through use of a parent , 
interview ins^ument. Descriptions of all the selected 
measures, together with interview instruments, are ^ ' - 
provided in App^^ndices A and B. * 

■* ^ > ^ 

Comprehensive, review of the literature, of environs- 
mental change provides mixed support for the hypotheses, 
of^ develppmental affects.^ Although theory and intuition 
suggest that the basic lifestyle changes associated with 
major family relocation should contribute to the cognitive, 
socio-emotional , and physical development of children., 
previous research is inconclusive, except perhaps in the 
area of physical development where significant reductions 
in accidents and poisoning have been found. The methodo- 
logical difficulties of most of these studies, together 
with the highly limited extent of the environmental 
change studied, conspire .1:p leave the questions of environ- 
mental impact in cogniti<rte\ socio-emotional , and general 
health unresolved. For thdse reasons, measures are pro- 
posed in ^each of these areass. Measures of objective gains 
in income, employment, and ^housing quality, together 
with measure of parental aspirations and commvinity 
involvement are. also attempted. 

Final selection amongsfck.lternatxve instruments must 
necess^ily reflect the subjective preferen/ces and interests 
of the^^Wv^stigation and thf^Work is no exception. It 
is important, however, to di|mnguish between biases of 
this kind, which reflect special interest in particular 
dimensions of development, an^|biases of another kind, 
which reflect culturally determined definitions of 
development and under-develop4ent . It is important, 
given the subject populations these studies, to 
recognize the difficulty of traKscending cultural 
differences in the measurement 'ot^ cognitive development 

^ : ' mX^ '■ 

^Sce Volume 111, LiteratureS*^Wiew. 
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in particfdlar, and , to maintain an' awareness that "under- 
developed" Tdy the standards of ^a* dominant culture is not 
necessarily under-developed by 'the standards o^ another 
cultur.e.- The, safeguard lies in the' caution with whiqh 
results are to be interpreted; thus ^ depending on pro- 
.f essional judgment of the validity of. a particular 
instrument; gains may -either be interpreted as "devel-r 
opment" or "assimilation." In either case they are * 
'results .of interest:. ' * * 
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5.1 Recommended Measurement Instruments for Children 

Recommendations for the measurement of children are 
presented in three categories corresponding to the cog- 
nitive/ sQcio-emo1:ional, and physical dimensions of 
development. Age group appropriateness is indicated as 
''follows,: I • 

. r ' . 'I 

X • . ^ 1 = pre-sahool 

/ * ^ ^ ' ' i 

'2 = elementary school 

' * "'J 3 = junior and senior high school 

Descriptions* of each of the recommended instruments are 
provided in Appendix ^Br 

5*1,1 Cognitive Development 

Four separate aspects of cognitive development. are 
addressed: verbal' skills, qoncept formation, school 
'achievement/' ahd general intelligence, Recommendatipns 
are as follows : I 

* •* 

Verbal Skills ,. . ' 

1. Peabody Picture Vocabulary Test - size of vocabulary 
(1, 2, 3) . , 

2. ITPA Subtest of Verbal Expression - Verbal fluency 
' . and ideationaT flexibility (1, 2) 

* ETS Story Sequence Test - ability to understand and 
produce a simple story (1, 2) . , 

'4.' ITPA Subtest of Grammatic Closure (1/2) 

Concept Formation 

1. * Sigel Object Categorization Test - Consistency and 
level of classif icatory skills (1, 2) 
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2, Zimiles Matrix Test - abstraction of similarities 
(W 2) ' ^ 



'school Achievement ^ . 

1, ' Metropolitan Achievement 'Test - reading a,nd math 
achievement (2, 3) 

General Intelligence 

1. Pre-school Inventory (1) 

.2, Stanford-Binet Intelligence Test (1, 2, 3) 

-5 ,1,2 Socio-Emotional Development * 

Five distinguishable dimensions of socio-emotional 
development are addressed: ^mental health, sel f -concept , 
future ^oals and expectations/ locus of control , and ' 
peer interactions. Recommendations are as follow?: 

Mental Health * * ^ . y 

1, Selected Subtests from California Test of Personability 
measures of personal and social adjustment (2, 3) 

2, Behavioral indicators of psychological and social 
adjustment (1, 2, 3) 



Self -Concept ^ J 



1, Brown IDS Self Concept Referents Test, (Par 1/ Self 
Referent} tl, 2) 

2, Cobpersmith Self Esteem Inventory (2,; 3) * \, ' ' 



Future Goals and Expectations 

1. Battle's Aciiievement Expectancy Scale (2, 3) 
Locus of Control 

!• Stephens-Delys Reinforcement Contingency (1, 2) 

2. Crandall's Intellectua^l Achievement Responsibility 
scale (2, 3) ^ ^ . 

3. Nowicki-Strickland Persoital Reaction Survey (2, 3) 
Peer Interactions 

1. Ohio Social .Acceptance Scale - child's standing in 
class and his perception of it (2,3) 

2. Parent and child interview items (1^ 2, 3) 

t * 
5.1.3 Physical Development . ^ ' 

No general pediatric examination yielding comparabi 
and quantifiable data was found appropriate for this 
study. . It is thus recommended that a series of tests 
screening for handicaps and tests specific to poverty 
and housing related problems be given as ^ battery. 
This procedure will be about equal in cost to a compre- 
hensive pediatric examination, but will provide more 
specific information. In addition to the tests, a 
parent questionnaire on previous immunizations, diseases 
arid othfer medical history, such as those used by school 
systems for mail responses, should be used. - 

The following test^ are suggested: 

(1) Hearing test (including screening for middle ear 
infecti,ons) 
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Vision test (in depth for detected abnormalities) 

Nutrition (anemia test, height-weight, vitamin- 
level test) ' * . 

Lead Poisoning (blooS'or urine test) 
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5.2 Supplementary Measures for Parents ' 

In addition to the basic test batteries described 
above, it is desirable tq^ collect additional information 
from the families- of the Itarget children. This is done 
by means of a Parent Interview Instrument.! The Parent 
Interview is designed to provide information on abjective 
gains (housing quality, spendable income and employment) , 
aspirations, and community involvement. D§ta collected 
along each of these dimensions will be treated as 
dependent variables in the analysis. 



The Parent Interview serves two additional purposes. 
A section on Peer Interactions corroborates information 
from the Ohio Social Acceptance Scale^ gathered for school- 
age children, and provides the only source of information 
on the peer interaction of pre-schoolers. Secondly, 
the first part of the Parent Interview provides demog^'aphic 
data required for screening and sample selection prior 
to the first survey wave. 



1 " S 

The Parent Interview Instrument is presented in 



Appendix a. 
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5.3 Cost of Administration 

Cost estimates are developed on the basis of 100 
children and 100 parents. SincQ. some parents will ha^^e 
more than one child under study,, the estimates may . 
somewhat high. The selection of 100 children who. meet 
matching variable requirements is assumed to required 
250 short screening interviews with parents. Child- 
interviews will ^not be administered to pre -school 
children. . ; 

1 

'^" ^^rent Interviews 

250 X P.I. Pt. l@4/day . 62 days | 
100 X P.I. Pti 2@4/day 25 days 

Cost of Interviews @ $20/day 't$l,740 

Child Interviews * S 

75 X C.I. ' @4/day ! 19 days 

Cost of Interviews* @ $2d/ddy 380 

Child Tests • * ' 

100 X Battery @ 2/day^ ^ 50 days 
(Preschoo3» 1 1/2 hours in 2 sessions 
School Age 4-5 hours in 3 sessix)ns). ' 

Cost of .Child ,T^sts @ $35/day ^ 1,750 

1 

Coding . \^ 

• •250. P. I. Pt. 1 @25/day 10 days • v ' 

100 P.I. Pt. '2 @12;5/day 8 days / 

- 100 C.I. . @20/day 5 days * ' ' 

100 Better i'es @20/day 10 days' 

Cost' of Coding @ $20/day 660 



^ Estimated average time per' child for group and 
individual testing . 
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Health Exajoinations • i . • _ ' 

- — 100 X Health Test Exam @ $20/test , $ 2,000 

Coordination * ■' ' , ; • 

1 coordinator for 30 man days . «■ • v 

- Cost, of coordinator @ $50/day 1,500 

<' • 

ESTIMATED TOTAL DIRECT COST FOR 100 . 

FAMILIES ANEj^^HILDREN . 8,030 

■'ESTIMATED DIRECT COST PER FAMILY AND • 
CHILD: $80,00 



These costs represent onLy the direct labor costs 
of carrying out the field work.^ There will, in addition, 
be some- required travel and, no«doubt, some- indirect 
charges such as overhead and administration expense. 
For 100 families and ©hil<iren, the_additional charges 
should be roughly as.fpllows: '\^) 



1 This is estimated as follows: Hearing. Test- ($5-$l'0) 
Vision Test • ($5-$10) Anemia ($1.00), Vitamin Level 
.($5.00):, Bioda or Urine Test for Lead Poisoning ($1.00)., 
.An average cost estimate of $20.00, which is roughly 
equivalent to a standard pediatric examination therefore 
'seema reasonable. ■ , • ^ - 
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Travel (Coordinator) 



Ro£ind-trip to site average 



30 per diems @ $25 



$150 
750 



^. Total Travel 



' $ 900 



Overhead (Qoordinator & Coders) 
100% of Direct Labor 



2,160 



General and Administrative Expense 

> 15% of Total Costs {$8,03(J+$900+$2,l'60) 



1,663 



Fee (7% of Total Gost^) 



892 



TOTAL COST PLUS FIXED FEE 



13,635 



There is, of course, considerable variation amongst 
contractors in the way in which they account for 
indirect charges; nevertheless, an average cost of around 
$136 per child should be adequate under almost any 
circumstances • 
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Family Name 



P^iREOT" 'INTEWIEir: 

Part I: Screening (either pa^rent) 



The information and opinions we will ask for in this interview are 
. children's development as it is related to housing. Everything yo^'^ay wil'l 
in strictest confidence by the research team. The results of the study may 
public, but oniy in statistical terms / such as group percentages. You as an indivi- 
dual will not be named or .discussed, and this intervi^ew will not be used by anyone 
else or for any other pxirpose* » ' ■ . • 

ADDRESS: 




TELEPHONE: 



CONVENIENT TIMES TO CALL: 



LENGTH OF RESIDENCE: 



Current residence 

Previous residences (going .back, in 
time to 1965) -addresses: 



Date Moved In- Length, of Residence 

years months 



NAME OF HEAD OF HOUSEHOLD:' 



NAME OF 'mother (if different) 



AGE: RACE: 
AGE: RACE: 



Employment status Head of Household 
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Full time 
Part time^ 

^^porary unemployment^ 
Perm^ent unemployment 



0," 
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FAMILY INCOME AND^ EI>UCA'FtON INPORMATION: * 





;HEAD OP 


^ OTHER INCOME EARNElRS (GIVE .RELATION TO 
• HEAD OF HOUSEHOLD) 




r eT ^ 


rel^n: reT^^n: freF^n: 


Occupation 
• (specific) 






* 






i 

. i 


Principal * , 
Employer ^ 


< * 


i 






■i 

* * * i 


r Annual ihcome-^ 
from -principal 
en^ployment 






7 






Other job (1) 




<• 


i « 






income from 
(1) 






* 


* 1 


< 

i 


Other job A2) 












Annual income 
from (2) 


- 










Total 

en^loyment 

income 

(annual) 








V 




Highest 
year 

education 
(or 

degree) 










. 


Supplementary 
education 
(night or 
technical) 








r 


1 

■ , .1 
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ADDITIONAL INCOME: 

' blfild Support r ' ' TOTAL ADDITIONAL INCOME 

Social Security ■ 

AFDC, ADC, or other ^ . TOTAL JOB 'INCOME 

• * welfare payments » Xfrom alx^ve: 

•„ .Unemployment compensation * 

- ' Disability " ' TOTAL ANNUAL FA^^lLy 

Pension - . ^ ' INCOME: 

Other ^ 



' Total 



^C HILDREN (In birth order) : 



Name 


Age 


Sex 


School 
Grade 


Name of Nursery 
or School 


Names and dates of previous 
Schools, Nursery Schools or 
Day Care Centers 












f 












































































































e 







Do any of the children we have listed have physical or mental disabilities? 
(Fill-in table below.) 

Have any of them spent prolonged periods (a month or more) hospitalized 
or confined to bed? If so, why? 

Are any of the children adopted or foster children? 



NAT-IE OF CHILD 


DISABILITY 


HOSPITALIZATION 


ADOPTED/FOSTER 
























« 


*■« . 

%■ 
































■' — ^ ' i 
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PARENT INTERVIEW 
Mother (attach Screening Interview) 

I.- EMPLOYMEJl#^f time lag since Screening Interview, check current employment and 

iould like to .know hqw living here has affected your family's ability 
^.;^^make a livifig.. First, can you remember the jobs held by your family's 
'Income earners before the present? We will take them one at a*time back 




rto(l965. 



MEMBER OF HOUSEHOLD 
(starting with head) 



PREVIOUS DATES 
-OF JOBS 



NAMES OF PREVIOUS 
JOBS 



ANNUAL INCOME 
(FINAL RATE 
EACH JOB) 

— \ 
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For each job change or new job since the beginning of your residence here 
was the opportunity or necessity to change jobs related to living hfere? 
(e*g,, easier access, better job market, etc.) If so, how was.it 
.related? (Repeat for OTHER working members of household.).' ^ ' ' 



MEMBER OF HOUSEHOLD 


JOB 


HOUSING RELATION 










































• 


1 






•i ■■• " : •■ 


















* ** 


















« 


















. .'^ \ 




i 


















1 






' a 1 ' — — — 


1 




i ' 

i ,, 






] • 


» , > 



\Vhat effect would you say, then, that living in this place has had on 
your family's ability to make a living? 

Helped ^ • 

. No Change . 

More Difficult . 
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II. SP^INDABLE INCOME' 



(1)' 'How much is yoa^" rent per month here? 



' 'Annual rent (to be :cOmputed' by inverviewer) 



t - « . ^ 
(2) How much was your ren€ per month where you lived jiast before you moved 
y here?' Annual rent: • 



(3) About 'hpw much 
money do you 
• ' have to pay 
each month in 
bills directly 
related to 
housing? 



C4) 



About how much 
do you spend 
on the- average 
each month on 
things 
indirectly 
related. to 
housing? ^ 



{ 



heat (no. mo. 

per yr. ) 



gae & elec> 



repairs (^ve. ) 



'. parking 



other 
(specify) 



■MONTHLY TOTAL 



transportation 



•furniture 



highear shop- 
ping costs ■ 



other 
(specify) 



'MOl^lTHLY TOTAL 



MONTHLY TOTAL 
(3) & (4L com- 
bined ?N 



PRESENT 
RESIDENCE 



PREVIOUS 
RESIDENCE 
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Ill, HOUSING AND ENVIRONMENTAL QUALITY 



PRESENT PREVIOUS 
RESIDENCE RESIDENCE 



(2) 



(30 



irxg ' 

Facilities * * * ^ • . 
Private outside entrance - . . 


YES 


NO 


YES 


111 

NO . 










Dual egress • , " * 










At least one window per room 










Electric lights and outlets in every room 










Installed heating in every room . . • 










Hot water • v , ■ 
— — ^ — ^ 










Storage (at least one closet per bedroom) 










Laundry facilities in. building " , ' • 










Complete kitchen (sink, stove, refrigerator) 










Complete bath (basin, toilet, -1:ub or shov/er) 










TOTAL (2 pts. each)yes 










Maintenance ^ — 

Immediate attention to plumbing or electrical problems 








Immediate attention to heat/hot water failure 










Free from infestation (rodents) 










Free from infestation (roaches and other- insects) 










.Sanitary garbage collection system (ask how & when 
collected) 


— - 








Structural safety (holes, railings, etc.) 










No flaking paint 










Adequate security (locks) 










Lit entrance and hallways 










Repainting at least every three years 










TOTAL (1-pl:- each) ves 










Occiipane^ 

No shared facilities (e.g., kitchen, bath) (3 pts. ) 




No more than '2 persons per bedroom (3 pts,) 










Ho more than 11/2 persons per' room 
(excluding kitchen & bath) (2 pts.) 








1 


TOTAL 






! 




HOUSING TOTAL (Max .40' ) 
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3^5^ = ivv -^"ASPIRATIONS. 



Names of- children, 



(1) 



(2) 



What kind of job(s) would you most 
like your bhijd(ren) to h^e when 
he (they) grow up? (Try t^ e^Licit 
answer without reading categories 
{^irst. Repeat for each' child, 
starting vith olde3t.) ^ 



Services (hairdresser, 
mechanic, etc*)' • 




Businessman 



Steady work in a plant 



Teacher/Social Worker 



Minister (Rabbi , etc > ) 



St. 



Office worker (clerk, 
secretary, efccO 



Professional sports 



Military. 



Housewife 



Professiopal (doctor/ 
-lawyer, etc.i) 



Own a small sfcore 



Other ; 



Do you think your child (ren) ' are 
likely to ^'get jobs as good as 
those you would ^ like them* to 
have? (WritI Yes,. No, in 
box.) 

How -far would you like your child 
(ren) to go in, school? (Repeat 
ferli fbr each child*) 



each 



\ 



Professional or 
graduate work 



Graduate from .a 
4*-year college- 



Some college but' 
less than 4 years 



Technical/ nursing ^ 
business school 
after high school 



Finish high school 



Don't care if fj^pish 



DK 
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Names of children 



(4) 



(5) 



Do you think your child (ren) ♦rrooa 
will get as far as you would like? ^avbe 




How good a student do you want 
your child (ren) to be with 
respect to his (their) studies?. 
(Read off the choices.) 



[Answer (6)- (10) for school-age 
children only. ] 

(6) Do you think your child (ren) 

is (are) doing as i^ell in 
' school as you v;ould like? 



(7) 



(8). 



(9) 



(10) 



"Do you want your child (ren) to 
study or read a regular amount 
'Of time for each school day? 

''Do(es) your child (ren) study or 
read as much as you would like - 
feach day? 



to take any lessons putside of 
regular school because you felt 
it would help him (them) do better 
*^in school? What kind? 



Do(es) your child (ren) do any of 
these things at present? 



♦Probably yes 










^aybe 










Probably no 










DK 










In the middle ox the 
class 










Above the middle of 
the class 










One of the best in 
the class 










Just good enough to 
aet by 










DK 










Probably yes 




















Probably no 










DK 










Yes 










No 










DK 










Yes • 










No 










DK 










Yes 










No 










es. ^ 










Yes 


• 








No 











(11) How important are 

school grades to you? 

po your husband? >^ 

to teachers? 

t0 ^ 1_? 

7 

(names of children) 



VERY 

IMPORTANT 


IMPORTANT 


NOT SO 
IMPORTANT 


UN- 
IMPORTANT 
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^^-/V> COMMUNITY SUBJECTIVE EVALUATION AND PARTICIPATION 



Hand Card 



(l)a. How would you rate 
this neighborhood on the 
following facilities and 
characteristics? ^ Please 
choose your answers for 
each one from the card. 

b. Now let's go through 
the same categories for 
your previous neighborhood. 



' (2). a. Using the same 
card, how would you 
rate the people in this 
.commtiiiity? 



b. .jtlow let's' go through 
the same categories " for 
your previous neighbor hood ^ 



Very good 
Good > 
Neither good nor poor 
Poor 

Very poor 



a. 



d. 
e< 
f . 

g- 

h. 
i. 
•j- 



a. 



b. 



d. 



PRESENT 
NEldHBOR- 
HOOD 



PAST 

NEIGHBOR- 
HOOD" 





VG 


G 


NG 
NP 


P 


VP 




VG 


G 


NG 
NP 


P 


VP 


Shopping: food 
























SHopping: other ^ 
than food 
























Churches 

(Synagogues , etc * ) 
























Medical' facilities 
























Transporation 
























uay c^are 
























Schools • ' 






















: 


Parks & Plavqnds.' 
























irOXjLce prouccuxon 


-1 — 






















Recreation (movies, 
luusejuxus f xxj^rarxes/ 
























Garbage collection, 
sanitation 
























Street clearance 
























Juvenile delin- 
quency; drugs, 
vandalism," etc. • 
























Adult Crime rate 
























Friendliness of 
people living in 
this pro;ject (bldg") 
























Helpfulness of 
people living in 
tliis project '(bV^n^"^ 
























Friendliness, of (Jbldn."^ 
project personnel 
























Friendliness of 
people living in 
this- neighborhood • 
outside the project 




















•V 


1 


Helpfulness of 
people living in ^ 
this neighborhood * 
outside the proieot 






















< 
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(3) 



About how many families in this project. do you know 
by name? Please list as many names as you fcan 
remember. The families you list will not be contacted* 
, Listing-- tlrem just helps us get more accurate informatipn 
about how v/ell people can get- to know each other here* 



FAMILY. NAME 


FRIENDS 






1 ^ 

































PROJECT - 
Total families: 
Total -friends: 



About how' many families in this; project woul^-you call 

your friends? (Check off jLisx in Question 3a*) 

Total: ^ , 

About .how many families in this neig]:ibQ;chood, not living 
in the project, do you knov; by name? Pi^ase list as many 
names as, you can remember. The families you list will not 
be '.contacted; Listing them just helps us get more accurate / 
information about how well .people can get to know each ^ 
other here* i 



FAMILY NAME 


1 FRIENDS, 




— ! 




















— 7 — J " 1 









NE5GHB0RH00D 
Total families: 
Total friends; 
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About , how many faitdlies in this neighborhood, not living, in the project, 
*^ould you call your friends? (Check off on list in Question 3c ♦) 
Total: ' * : ^ - 



Da most of your friends live either in this project ,or this neighborhood? 

. - If no, do miost of your friends live in your tontier . v.. 

neighborhood? - ^ • - 



f. Do you have as many friends now as you did where you lived before 
moving here? [ , 



(4) 



Do you go to meetings, 
service's, or other 
events for groups of 
people in this 
neicfhbcfrhood? About^ 
how often'? 



(5) 



VThat places in this 
neighborhood do you 
visit? About how 
often? 



' "'-^ 

a. Church (Svnaaoque) 


Weekly 


On^^Z 
month" 


. . 

Several 
ixxaesy 
year 


Once/ 
year 


Takes j 
Children 












b. PTA (or oth^r 
school group) * 












Cltibs ^ 












d. .'Political groups 












e. Boy or Girl 
Scout mothers 












Volunteer services 












^. Tenant organizations 












vh» Sports teams 












±. Other 












a. School 












b, Librairy 












c. Parks & Playcxrounds 












d^ Church (Synagogue) 












e. Movies 












f* Clinics (medical 
facilities) 












g* Museums 












h» Bowling alleys 

(or other sports) * , 












!• Other 













(6) Do you usually tjgi^e your children to the ^ 
"meetings or places" we have just 'talked about? 
(Check '^each item in last cplumn. )./,,, 



-.(7) 







♦ 




, ♦ 


4/t 











r Weekly 


Once/ 
Month 


Several 
times/ 
voar 


Once/ 
year 


With 
whom 


J 

Are there meetings or 
plac^sr your^ children 
go to by themselves 
or with peopl^ in' this 
heighborhood? About 


a. 


Libraries ^- • F - 










■ 


b. 


Scouts 












c. 


Church/ (Synagogue) • ' 














Sports \teaifis 












e. 


Lessons ' "* ' *^ 












how often? Who do they 


f . 


YM(W)CA 






• 






usually go v/ith? (With 


g- ' 


Movies 1 












^friends r alone* with 


h. 


Sports events 












o their adults?) 


i . 


Playgrounds' & parks 
















Other 





































' (8) 



wtfo usually takes care of your children when you cannot? 

» ' 

a. Older sibling 

b. Relative (in c$iild*s home) 

* \ . c.'. Relative (outride home) 

\ d.. Non-relative (in home) 

e. Non-relative (outside home) 

\ ^ f . Daycare center 

g^^Qther \ 



(9) About* how many hours "a week is 



(Repeat for each child.) 



name of child 



cared for this way? 



* hours/wk^ 



(10) Do you think your children would "have had good opportunities 
to get ahead in life if you 'had stayed in your previous 
neighborhood? ^ ; ^ . ^ 



(11) Do you think your childten will have gdod opportui^it;ies to get 
ahead in life if you stay, in^'this neighborhood? • 

(12) Do ygu think youf children would have a better chancer to get 
ahead in life if you moved to another home and neighborhood? 



^.(13) Do you think you will move anywhere v?ith better opportunities 
for your childrfen while 'they are still in school? Yes 



ERIC 



IIG 
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No 
DK 



VI. CHILDREN:- PEER RELATIONSHIPS 

.ay About how inuch time do(es) your child (ren) spend with children Uving inside 
this ^project and with children living outside the project, but xn this 
neighborhood? 



Project , Neighborhood 



Sometime every day 

Sometime severa^l; days a week 

Sometime once a week ^ 

Less' than once a week 

Rarely 

Never- 



(2) a. 
b. 



Do you think you know \>/ho, your child (ren) 's friends are? 

Can you try to list as many of your chil'a(ren) 's friends by name as 5;ou 



ERIC 



i-r»T> rfr>i- fiar-h rhild in turn)? - ^ ■ 


Name of 


,Name of 
friend 


bCnOOx Ox 

friend 


school 




LOCATION 


^TIME SPENT W: 


CTH 






































































































































— . 



































































































































♦ 
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X2) Do you think your child (ren) has enojugh opportunity ^to.inakQ 

• friends^ here"? ' - - - - . - - 

(4) . ^ .Do yjDu think youf child (ren). has (have) as many ' friends .here 

'as they di.d vSiere they lived before? ' ^ , 

(5) , Are you pleased with the kinds o^ friends your . children have 
" " " here?' ' > If nOf why not?. ' ' - 



(6) Can you des-cribe any differences in the kinds^ of friends 
your child Cren) ^has (have) hete and.where you lived ^before? 
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CODING OP PARENT INTERVIEW- \ . 

PART- 1: Screening (10 data points') 
^' " (duplicate care reqviired for each subject* child) 

CARD I 

Colxunms- ... • 

i-5 Project name code' 

6-10 Family name code 

11' No. residences sifice 1965 (9=9 aad above). 

12 • > . Sex of head of househo^ld (M or F) 

13-14 Age of head of household . 

15 Race of head 'of household l=white 

• 2=black 

J ^ ^ < ' ^ , 3=Spanish 
- ' ' * 4=briental 

r-— • • . 5=other' 

16 . . ^ Occupation head of household 

9=professional^ 

^ ^ , technical 

8=managers, 
E^roprietors 
^ 7=clerical 
6==sales 
5=service 

- \ workers 

■ 4=craftsmenf 

^ foremen 

. 3=operatives - 
^ " • (skilled) 

■ J * ' ' ' ' • 2==laborers 

0 (unskilled) 

' ' ' ^ • l=household 

17 Occupational status of l=f!uil^ time ' 

head of household employment 

2=part time 

employment 
3=1 plus 2 
^ 4= temporary un- 
employment 
5=retirement 
(permanent 
, , unemployment) 



of 



Educational level 
o£ head/ of hoiisehold 



Total Annual FanuTly, 
Income 



8=5Advanced 

degree * " 
7=graduate of 

4 year college 
6=college (less 
than 4 'years) 
5=technical, 
nvirsing^ 
business ^ 
training after 
' high school 
4=graduate 

high school 
3s=some high 
' s.chool 
2= 8th grade 
l=less than 
8th grade 

'launder $3^.000 
000-$.4r500 
^$6/000 




5=$7/500-$9,000 
6=$9,000-$10,500 
7=over $10^500 



Absolute Family Income 
(Annual) 

Total No. Members- Housiehold 
No. Children Household 
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CODING OF PARENT INTERVIEW 



Part II: Mother 

[Coding will be done separately for each child in the study. 
Where questions are answered for each child (e.g. Sec. IV) f 
code only ansv;er for specific child; where collective answers 
are given^ they will be entered as collective scores for 
every child (e.g., V(7)]. 

CARD II ' * . 

Coliamns 



I- 5 Project Name Code 
6-10 Family Name Code 

II- 13 Child Name Code 

14 1(1) No. Jotte^Since 1965: Head of 

Household 

15 ' 1(2) No. Jobs since Movi^ng to Current 

Address 

116 1(3) ' Relocation Effect on Earning a Living 



l^Helped , 
2^No Change 
3=More difficult 

11(1) Annual Current Rent 

Annual' Current Income 

. Annual Current Rent /Annual Current , 
Income 

(Express fraction as 2 digit number, 
e.g., .25^25) 

Annual Previous Rent 

Annual Previous Income 

Previous Rent/Previous Annual Income 

II (2) -II (I) (Signed difference, e.g. 
-14, in rent/income fractions) 

Additidnal Housing Expense (Absolute) 

Additional Housing Expense (Annual)"/ 
Annual Income 

46-47 III(l) . Total Housing: Facilities Score 

' (Max 22) 
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17-20 
21-25 
26-27 



28-31 11(2) 

32-36 

37-38 . 

39-40 11(3)' 

41-43 
44-45 



48-49 111(2) Total Hous.inig: .Maintenance Score 

(Max 10^)^ 

50- 111(3) Total Hoxising; Occupancy -Sep re 

1 (Max 8) ' 

51- 52 • I * Housing Total .(Max 40) 

53-54 • III(l) ' Previous Housing: Facilities Score 

55-56 111(2) ; Previoias HousingT Maintenance Score 

57 111(3) Previous Housing: Occ, Score 

58-59 Previous Housing Total 

60-62 ' Present-Past Housing Total 

(Signed Difference) 

63 IV(1) 0=No 

l=Yes 

64 IV (1) Classify job aspiration for Subject ' 

Child by Code for Part J: Occupation 
~ ' — Head of Household (Code: Card I, 

. ' Col. 16) , . 

3=9 or 8 , 

' . ' 2=7 to 3 

. i=2 or. 1 

65 , Difference Between Occ. H. of H. 

and Aspiration' for Child: 

3=child higher 
^ 2=equal 

l==child lower . 

56 IV (2) Job Expectancy 3= Yes 

2=DK 

67 IVCi^' Educational Aspiration . for Child 

(Code: Card I, Gol; 18) 

3=8; 7, or 6 . 
2=5' or 4 
1=3/ 2,f. or 1 ■ 

Add; 9 Don't Care or. Don 't ^ Know 

68 IV (4) , 3=Prob. yfes ' 

2=Maybe or DK . ■ , 

• l=Prob.. no 
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§9 



IV(5) 



JO 



71 



72 



73 



74 



75-76 

77-78 
79 



IV(6) 



IV(7) 



IV(8) 



IV(9) 
IV(IO) 



IV(ll) 



best in class 
3= above middle 

2= middle 

1= get by 

DK * 

3=Prob. yes. . ^■ 
2=JMaybe or pK^ 
l=Pxob' no 

3=yes • 
2=DK 
l=No ^ 

\ 

3=yes ■ • 

2=pK 

l=no 

4=(9)yes, {10)yes 
3=(9)yesr :(10)no 



(Class rank' 
Aspiration). 



CS cdi^oo 1 , p er f ormanc e , 
expectancy) - ' 



(Study Aspiration-) 



(St^Sdy .expectancy) . 



(Edubational 



4=?Very iitportant 
3=Iinp6rtant 
2-Not so important 
l=Unimportant • 



(EducaticHxal 
motivation). 



Total Aspirkt.ipn Sdore: Stun* 

Scores in Cols/ 54, 55^ 57,.59, ^1 *^ 

(range 5rl5) ^ , • . 

Total Expectancy S,c0re: S:um $cpres. \ 

in Cols'. 56,.58//^iJl^ 62 (r^^^ 3-12). 

Total Motivation SCoi^e: - Sum 

Cols. 65-65, "e'lr-eS " (range i-Sj 
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CABD . Ill 

I- 5 
6-10. 

II- 12 



13-14 



15-17 



18 



19 ' 



go -21 

22-23 
24-25 
26-27 
2 8-29 ■ 
30 

31 
32 



V(l)a 



V(l)b 



V(l)a-b 



V(2)a 



V(2)b 



V(2)a-b 

V(3)a 
V(3)b 

• V(3)c 
V(3).d* 

• V(3)b, 



Project Name Code 

-Family Name Code 

5=VG . ' • 
4=G\ 

3=NG/NP 
2=P \ 
1=VP', 



Total all present neighborhood 
facilities . (range 14-70) 



5=VG 
4=G - 
3=NG/NP 
2=P \ 
1-=VP \ 



Total all past neighborhood 
facilities (range 14-70) 



Present Neighborhood - Past 
Neighbo^h.obd (Negative if present 
poorer, \e.g. , -23) 



5=VG 
4-G 

.3=NG/tfP 
2=P 

1=VP' > 

5=VG 
4=G 

3=NG/NP 
2=P 
•1=VP 



Average Rating of People 
this neighborhood .(a-'e) 



Average rating, of people 
previous neighborhood 



Present-Past\ (Negative if present 
poorer) 

No. Project E\ami.lies Known by Name 

No. Project Families Called Friends 

.No. Neighborhood Families Known by Name 

No.. Neighborhood Families Called Friends 

l=jMore friends! in project and neighborhood 
0=More friends \outside ^ 



V(3)r- 



l=More' friends 
b=More friends 



low 

)reVious ly' 



i 



33-34 V(4) 4=weekly 

3=once/month 



Total score 



2=sevej:al times/year ^ ^ . 

l=once/year 

35-36 V(5) 4=weekly 

3=once/mQnth Total score 

2=several times/year places visited 
,1= once/year (siiine a-i) 

37-38 V(6) ' Total No. of Checks in "Takes * 

Children" coliimn in (4) aiid (5) 

39-40 V(7) 4=weekly 

" 3=once/month Sim independent 

. , 2=several times/year activities of 

l=once/year ^ children 

41 v(8) l=a 

2=b ^ * , 

- 3=c .'. H • 

• ; ' ^ ^ . . • ^4=d * • ' • . 

5=e r 

6=f , ' * c ' 

7=g , 

42-43 ^' V(9)' ' . Hoiirs per week subject child 

'is cared for ^ ^ 

44 v(10)-(12) 3=this neighborhood "best 

2=no* difference ' 
• l=this neighborljoo.d poorer 

45 . V(13) 3=yes ' 

2=DK (Aspiration to relocate better) 
l=no 

, Vl(l) 6=5ome time/day 

5=several times/week 

4=once/week 

3-less than once/week 

2=rarely . ^ 

l=never 
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46 • Time spent with, project children 

» (1-6 above) 

47 ' ^ Time spent with neighborhood 

children (1-6 above)' 

48 . ^ 1=36 is greater 
- > * * 0=35 is greater 



^49-50 VI(2) . No. friends listed for Subject child^ 

^ 51-52 No. "friends in same school 

53 Time spent with project friends . ' 

54 Time spent with neighborhood 

friends . 2°°^^ 1" 

as in CO 

55 Time spent with outside 35&36 

friends 

56 VI (3) , * • 4=all e "yes" 

(A\ rt;^ "yes" (Satisfaction: children' 

2=1 "yes" friends) 
l=no- "yes" 
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PARENT INTERVIEW: DEPENDENT VARIABLES 



Parents : 

.Material Gains: 
Employment 
^ Income (spendable) 
Housing 
Community 

Social Integration: 

Friendships - 

Community Participation 
Self Concept-Outlook , . 

Aspirations for Children 

Expectancy for 'Children 

. Subjective Gains: 
Employment 
Priehdship 
Community: 
^ People . 

Facilities 
Participation 
Sxom Evaluation 



QUESTION 



Screening. 
Interview 

11(1) (2) 
III(l)-(3) 



CARD NO, 
AND 
COLUMN 



1117 

il' 39-40 
II 60-62 



(Community Evaluation 
Scale Present-Past 
Difference Score) 



V(3)a.-f . 
V(4),(5) 

IV(1)-(11) 
IV(1)-(11) 



1(3) 
V(3) 

> 

V(2) 
V(l) 

V (4) , (5) 
V(10)-(12)' 



III 22-32 

I 

III 33-36 

II 75-76 
II 77-78 



II 16 

III 23-32 

lil' 18-21 
III 11-17 
III 33-36 
III 44 



Children ; r 
. Social Integration: 

Friendship J 
Community Participation.; 

- " .127 



VI (1), (2) 
V(6),(7) 



III 46-55 
III 37-40 



I . FRIENDS 



CHILD INTERVIEW 



Family name 

Child's name 

Age: Sex: 

Address : 



Race: 



(1) a. About how many kids in this project do you know by name? Can you name them 



LOCATION AND 
NAME OF CHILD 


• 

SCHOOL 


/■ 
{ 

GRADE 


* 

check one 


^o'Ni^k /i A 

0 ^/V A/V G// JJ^ 

o >YeP ^/j^ ^/fi / *<2/:s 

M /cf > 7^ 7?^ 


BEST 
; FRIEND 


FRIEND 






/ / / /^oV_ 
S SP.ENT WITH . . • 1 


Project • 
















• 
































































- 
























* > 








— 1 1 






















i 

























































































































































Neighborhood .\ 












































































































, y -> 






















-« 















































Outside 
Neighborhood 










— ^ 










































r 


























































« 
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b* Which of the kids you have named would you call your friends? (Fill in tafcjle 
above •) - , ^ 

Cip-^'tthich' of those friends would you ca?ll "best friends"? . 
*' . ■ 128" 

' ' ' • 



(2) a. How many kids in this neigl>borhood/ but not 'living in the project, do you 
know by narae? Can you n^e them? (NeigHborho9d is r;oughly defined as 
' elefiieotary school district*) Do tliey all go to. your school? What grades 
. ' are they In? (Fill in table above 4) 

h. Which of these kids would you call friends? (Fill .in table above.) . 



c. Would you call any of them "best friends"? (Fill in table aboyeO 

(3) a, lib any of. your friends live outside this neighborhood? Can you name them 

and teir me^^at 'schools they go to? " (Fill in table above.) 

b. Which of them live in your old neighborhood? (Before you moved here?) 
(Mark old neigl^orhood friends with asterisks.) (Fill in tabTe above.) 

cV'^Are any of them "best, friends*.*? (Fill in table above.) 

(4) Now I will read off all the kids* names We listed, and I would like you to 
tell me about how much time you spend with each of them. If you see them only 
a couple of times a year, tell me that, or every day, week, and so on. ' 
(Fill in table above.) 



II. : COMMUNITY FACILITIES AND PARTICIPATION 

(1) Do you belong to any clubs , teams, or other groups that have regular meetings 
or activities? • • ...^ CV 



GROUP (check) 


FREQUENCY OF MEETINGS 


REGULAR ATTENDANCE I 


Scouts 






Church 






yM(VOCA.- 






Bovs Club 






Little League 






Other teams 






School clubs 






Outsidfe clubs ' 






0 the r ( spec i fyj^ 







(2) What kinds of places in this neighborhood do ypu go., to? Aboujt how often?. With 



::erjc 



PLACE 






FREQUENCY 






Library 






















yM(W)CA' 




















-\v<\- ■■■ 


^rks/Playgrounds 






















r c he s /S y n agogu e s^ 






















Movies 























Bov/Iing. alley 






















Skating rinks 






















Swimminq pools' 






















Clinics 






















Special stores (specify) 






















Gyms 






















^Olher (specify; _ 
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c^^it;'- '/Ili*^ ACTIVITIES AND ASPIKATIONS 



(1) a.' Do;you have any paid' part- time jobs? What are they?^ 



0 



JOB -1 














1 > . . ' • ' ' . ' / " 








1 : . -A 





b« (If jobs) About how. many hours a week do yoii spend working? 



^<2) a, Wh'sit three things would you say you spend, the most txine 



watching television 
organized ^spoi^ts » 
unorganized sports^ 
working (paid jobs) 
visiting friends 
visiting relatives 
studying 

helping around the. 
hous.e 

taking care of ' 
younger children 

messing around 

going to movies . 

going places (yM(W)CA; 

librajies> museums, 
• etc. ) • , '\ ' 

school related activi- 
ties (clubs., news- 
paper r ^ftc.j 

holibies 
'Other: . 



TIME SPENT 


WITH- WHC)M 








































































b. About how mjany hours a week do you spend doing' each of 
^ these things and with whom? (Fill in above table.) ^ 

(3). Clan yoa tell me three things you like doing best after school 
and on weekends? Tliey might be things other, than those we 
aljready mentioned— just think about things you like doing best 

• ^^^^ven if . you don't often get to do them. \ \, , 



C 



1(4) a. 



What kind of job would you most 
. likj5 to have when- you are grown 
.up? 



What kind of job do you think you 
will have when yo)i are grown up? 



m a^ 



b* 



How far would you like to go in 
school? 



How far do you think you will go 
in school? 



oervjices- ^nairctresser # ^- 
mechanic r etc*) 


MOST 


EXPECT ^ 






Businessman 






Steady work in a plant 






Teacher/Social worker ,* 






Minister (Rabbi/ etc.) 






Off^ice worker* (clerk* 
secretary / etc.) 






Professional sports 






Military 






Housewife , ' 






Profess ional ( doctor , 
lawyer/ etc.) 






Own .a small store 






Other : 






Advanced -decree 






Graduate from f our- 
^ear college 






Some college (but/ 
less than four vears)- 






Technical/' nursing/ , 
business -course;-.:^ ' 






Finish high school. 






ischool until. a:cfe "16. 






Would quit' nbw^ if fcSbuld ' 







(.6) ' What, are all the subjects you have; in scboQl this year? 



(Malce sur6 all are listed.) 
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(7) [interviewer: .Fill in names of all English/Language and Ma^h 
Subjects for each quadruple set of questions which follow.]^ 

/ • a. VJhat grade do you expect to get ii) ^ ' on your 

next report caird? - (Circle^ ohe.) ~ -^^^ ^ 



A A- B+ B:B- C+ C C- D+ D D- 




*b. Wljat is * the lowest grade you coMld get in - • 4f 

on your next, report card/ that you .would be satis^fied 
with? 1- . 



c. How certain on' a scale f rpm-'-l-lO^ with 10 being most 

certain r are you that you could get a ^ [Fill in 

answer to (7)b.] in , ' ? 

12234-56-789 10- 
Uncertain Certain 

d. How important is to your if 10 is very. 

important and 1 is not- at all important? ..^ 

1234567. 89 10 
Not at ' Very * 

all important, 
inportant. 



NEXT SUBJECT ' 

e. VJhat grade do you expect to get in , on your 

next report card? (Circle one.)' 

A A- 'B+ B B- .C+ C Cr- D+ D *D- F 

f . ' * What is the lowest grade you could get in ; • • 

on your next report card^ that you would be satisfied 
with? 

• A A- B+ B B- C+ C C- * D+ D D- . F 

g. How certain oh^ a scale from 1-10, with 10 being most 
certain, are you that you could get a \ (Fill' in 
answer to (7)f , in \ ? 

1 2 3 . 4 % 6 7 8 9 10 

: Un ce r t ai n * Cext ai n 

* * ' . 

h. ^ Hov7 important is - to you, if 10 is very 

important and 1 is not at all i^nportant? 

1234 5 6789 10, 
Not at Very 
all important, 

important . 140 . / ' 

.. ' 132 . " ■ 



•NEXT SUBJECT . C ' ' - ' 



1. 



V/hat grade do you expect to get in orh your 

ne?ct report card? J Circle one.) 



A A- B+ B B- C+ C C- D+ D D- P 



. "What is the lowest/grade you could get in 
•'^ on your next report c^rd, that you would be - satisfied 
with? ^ * 

A A- B+ B B- C+ C C- D+ D D- P-: 

How certain on a s*cale f};om 1-10^, with 10 being mos^t \ 

certain/ are you that you could get a [Pill in 

answer to (7)j .] in -• ? ~ 

12 3, 45678 9 10 
Uncertain Certain 

How important is ^ to you, if 10 is very 

important and 1 is not at all important? 

1 2 3 4 5 . 6 7 8 9 10 
- ■ *' Not 'at'! Very 

fll important. 



important. 



NEXT SUBJECT . 

■ ' , • • • . (*• ^ ' 

in. What grade do you -expect to get in • on your 

■ next re|)ort card? (Circle one.) *~! ', 

• ^ * A A- B+ B B- C+ C C- D+ d1 D- F ' 

n. What is the lowest grade you coul-d get, in i 

on your next report card, that you would be g-atis fifed " 
' ■ • , with? 

y . , A A- a+ B B- C+ C C- IH- D D- F 

- ■ . ' ■ . ■ > .■ ' ^ 

o. How certain on' a scale from 1-10, with 10 being most 

certain, are you that you could get a _____ [Fill in 

answer to (7) n ] in • — 

' ■ . , . , 1 . 2 3 4 5 . 6 7 8 9 10 

'Uncertain ' Certain 

7-'P« How import;ant is . ' to-. you, if 10 is very 

r . important and 1 is not at all important? 

" 1 ' 2 3 4 5 6 7 8' 9 10 

Not at . Very ' *• 

■ ,^ .. ' f 1 d 1 • important. . . 

rni/-- important. * * . . . ? 

ERJ.C <^ , 133 



^ q. What>.grade do you expect to get in 
: next report card? - (Circle . one . ) 



on your 



A A- B+ B C+CC G- D+ P D--; P ' 

r. What is' the lowest grade yd.u' could get in 



on your next xeport card, ^that^du would be satisfied 
with? • » • • . • « 

/ A A- B+. B B- C+ C C- ' .D+ 1?\ - 

« , . » 

s* How certain on a scale from 1-10, with 10 being- most 

certain f are you that you could get a ' ^ [Pill in : 

answer to (7) r. ] in I ? 

1 2 3 4 S 6 7 8 9 1<) 
Uncertain Certain ' . * ^ 



t. ' How important is 



to you, if 10 is 'very 



important and 1 is not at all important?. 

1 2 3 4. 5 6 7 8 9 10 
Not at • Very . 

ali important.; 
important.. 



NEXT SUBJECT 



What grade do you expect to get' in 
next report card? (Circle one.) 



on your 



A A- B+ B B- C+ C C- D+ D D- P 



What is th^. lowest grade you could get in 

on your next report card, that you would be satisfied 

, A A- B+ B- B-^ G^^&-Gr t)+ D P ' 



How certain on a scale ffogi 1-10, with 10 being most . 

certain/ are. you that you could get a ; ^ [Fill in 

answer to (7) Vi], in- > ^ ? 



X. 



12 3 4 
Uncertain 



5 6 7 8 9 10 
Certain 

to yojif if 10 is very 



How iinf>ortant is ^^^^ , 

important and 1 is not at all important? 

'•1 2 3 4 5 '6 7/8-9 10 . 

Not *at * Very 

r '*/ ;* all important. 

. ' ' itnportatht. ^ . ' 
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(8) How important are good school grades to you? 



1 


Very 

important 


Important 


Not so 
Important, 


Unimportant 


YOU ! 








— ^ — ' 


jMOTHER 1 






i 




FATHER i 










[TEACHER 











i ■ 



How important are good school grades to your mother, 
your father, your teacher? Fill in above table. 
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CODE BOOK - CHILD INTERVIEW 

CARD IV > ' 

Columns Question r ' . 

I- 5 - ^ Project name Sode 
6-10^ Child name code . 

II- 12 Age _ 

13 ' * Sex 

14 Race l=white 

^ ' 2=black ' 

3==Spanish 
4==0riental - 

5=other ♦ ^ 

15-16 1(1)- (4) No. project kids known ' ' ^' 

17-18 No. project kids called friends (inc. 

best) 

19-20^ No* neighborhood kids known 

• " ' \ 

21-22 " Nq. neighborhood, kids called friends 

, (inc. best)- 

23-24 ; > ^ ^ - * NO. outside, kids known 

'*2t5-2o ^ ' ' ♦ ' No. outside kids called* friends 

\- , - (inc. best) • ' 

27 , • . *• 3 «=''most best friends iri project 

. 1 * ^ . - 2 ,«= most best .friends* in neighborhood 
. ' ; ' ^ 1 « most best friends in'' dtitside 

*28 * . 3 ==-most'time (outside of ^school) 

' ^ 's^jent with kids in project 

/ ^ .•.2-«= most time (outside of School) 

-V^ * spent with kids in neighborhood 
/ V ' i/. . 1 « mo^st time (outside^ o^ -school) 

V ^ igpent with kids outside ^. 

29* • ' 2 «= most friends **(inc* . best) fn same 

' school 

' ^ * ^1 >p,most friends (inc. »best) in % 
• * % ' / ' /different school * 

• ' ■ 13 6, ' : 



No .'groups belonging to '/VI . / 

n6»' gi;pups ^belonging -^o - ire.gular ■ ' [ , 
at'tenclance// * ^ ^ I * * . 

No. cipiratiimity acilit^^ 

least, seyera'i* times per raontih ' 

No. community facilities used' at least 
a few times, per ^ year ' . 

1 facilities mostly used alone 

2 = facilities mostly used with friends- 

3 - facilities mostly used with parents • 

4 = facilities mostly used with other 

adults 

No. part time jobs 
Work hours per week • 

1 = Sports and other purposeful -social 

activity 

2 = work (jobs, studying , chores , etc.) 

3 = passive' activity ,(movies, TV) » 

4 = visiting ' 

5 = school rel. .activity ' / 

6 = educational activity ♦•(libraries , 

museums) . • 

7'= aimless activity ("messing ciround" ) . 

8 =. solitary- purposeful activities 

(hpbbies , ,etc. ) - . , 

9 = other 

1 = activity primarily .solitary 

2 = activity primarily ih family ' , 

3 = activpLty -^priiSaarily with friends- . . 

4 = activity primarily with other adults 

1st ''preferred activity (Code to*be.; 
2nd preferred activity developed ^ , 
3rd plref erred activity from ^answers * 

, obtained) 

Job aspiration 9=prbfessional, technical 

8=managers & proprietors 
7=clerical 
6=sales 
' 5=service workers' 
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4=craftsmen, 'foremen 
3=operatives (skilled) 
2= laborers (anskxjled) 
l5=household 



Job expectancy '* \ ^ 

^ \ 

Dif f': ^ 3 = aspiration higher ■ 
2 =r . equal asp/exp 
1 = exp higher' 

Educ, aspir, 

Educ. expect, * , ^ 

Diff: 3 = aspiration higher 
2'= equal asp/exp 

I exp, higher 

Average grade expectancy language 
subjects 

12 = A 

II = A- . 
, 10 = B+ 

• ■:: 9 = B ••■ 

8 = B- 
7 = C+ 
6 = C 

■\ 5 =• C- . - ' ' 

4 = D^T 
3 = D. 

2 = D- • . " 

.1 = P' . 

Average lowest grade satisfied with 
(language") . * . 

Average certainty of satisfaction 
(language) 

3 = expectancy higher than, satisfaction 
2 = expectancy, equal, to satisfaction 
1 = expectancy lower than satisfaction 

Average importance rating (language) 

Average grade expectancy math 
12 = A ' ^ 
■ 11 = Ar- 

- ■ 'lb =-'b+ 
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9 
8 
7 
6 
5 
4 
3 
2 



B 

B- 

C+ 
C 

C- 

D+ 
D 

F 



' Its 



^ 



*59-60 ^ . , . Average lowest §rade satisfied with • 

/ ^ (math) 

61-62 Average certainty ,of satisfaction 

(math) " . 

63 . - ' 3 = expectancy higher than satisfaction 

2 => expectancy equal tq satisfaction 
1 = expectancy lower than satisfaction ^ 

* . ' ^ • Average importance rating (math) 

64 111(8). - '-Grade importance; you 

. ^ ^ . ^ ^ . 4 = very importarft ' . - 

3 .= important . c, 
, \ ' 2— noB. so important 

' 1 = uniinpprtant » ^ ^ 

65 : ; /• Grade importance: mother 

4 =r very important - / 
3 ^ important ^ i 

2*= not so important 
\' .> ^ ^ . 1 = unimportant . 

' 66' - ' * Grade importance: father 

; , . ' 4 = very important 

r\, . : , ' . ' 3 = important ^ - 

; ' . 2 = hpt so important 

/ ^ . ♦ \ * ' unimportant 

' 67 \ ^ ; Grade importance: . teacher 

. : . 4 == very Important 

/ ^ . V ' ^ * ' '3 = important 

* . , , ' - 2 = not so 'important; 

i = unimportant' 
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CHILD INTERVIEW: DEPENDENT VARIABLES 

. ' • "^"""""^ 

. CARD NO .' 

• ,^ » QUESTION - COLUMN 

Social Integration: 

Friendship (Peer Relations) 1(1) -(4). IV 15-29 

(Summary Scores) ' IV 27-29 

Community Participaition - 11(1), (2) ' IV 30-35' 

Activities III(l)-(3) IV 36-43 

(Siammary Scores) IV 39,41' 

Self-Cbncept-Outlook: - ^ 

♦ * • ' 

General: Aspirations III(4)a., IV' 44,47 

• r (5)a. 



Expectancies III(4)b., • IV 45,48 
, ■ (5)b. 

Aspiration- III(4)c., IV 46,49 
Expectancy (5)c. 
Differences 



School: Exoectancy, 
Motivation , Satisfaction 
(Battle) 



Average Expectancy - . 

(Language) 111(7) IV 50,51 

(Math) 111(7) . ' IV 57,58' 

Average Satisfaction 

(Language) 111(7) IV 52,53 

(Math) 111(7) IV 59,60 

Differ'ence 

(Language) 111(7) ■ • IV .56 

(Math). . Ill (7) IV 63 

Confidence * 

(Language) IV 54,55 

(Math) ' . IV 61,62 
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Self -Concept-Outlook: (continued) 

s 

' School: (continued) 

— -S<3feool Importance III (8) IV 6,4 

Perception of 111(8) ' IV 65-67 • 

School importance 
to others 
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APPENDIX B 



Recommended Measurement 
Instruments 



. ■ - BAT-HiE'S MEASURE OF ■ 

ACHIEVEMENT EXPECTANCaCES i GOALS, AND VALUES 



BEHAVIOR .MEASURED; - Achievement goals and 'expectancies . 

^AGE-pRADE RANGE; ,^Used with Grades. 7-9 in two -research 
"studies (Rattle, 196^/. 1966)*^ No reason why it could not 
be ,]ase3 with ^elementary '^s^jhpol' children Af they receive^ 
letter grades in Math and English. . * ' . * 

* . ' 1 ' ' ' ' * 

C ' t . 

• ' * ■». ' 

ADMtwISTRATION: .Group administered writ^ten questionnaire. 
No time given/ but v^ry short, ' ' 

"Operational' DESCRIPTION^' dii id circles point on a letter 
grade scale to indicate his Minimal Goal, Minimal Goal 
Certainty/ Expectancy, Jibsolute Attainment Value, and- Relative 
Attainment .Value in Matheina,ti cs and English, Each question- 
naire' also contained filler items, , ■ ' < 

i - ' ■• ' ' 

FOI^: ''Still'^a research instrtiment; ♦ 

^ \ ' ' 

NORfdS.t None, As any . norms wo\ild b,e x:elative to 'the - 
grading' system^of a particular school,, statndarcjization v 
would be meaningless^ ' % * • ' - * •' 

VALIDItY: • . * ' ' . ^ ' - • . 

Content , Questions directly tap desired variables in 
two school 's.ubject^. Math and English, ^» 

Construct , Minimal -goal certainty and expectancy are 
correlated in, 7th to 9th graders {^6,46, N=74) (Sattle, 1965): 
In larger samples (N=250-5bo) frpm^^same? source^ attitudes , 
'to Math an4 English -were cjb^reld-feed: ^ * ' - ^ 
' ^ ; . ' ' Expectancy: rp = 0,51 ""^ 

/ f "" Minimal Goal: ' ±^ -0.62 ' ^ 

rjiniinal Goal Ci^^tainty:-. ' 'r^ =5^0,49*^ 
Absolute^'Attaitiment Value: » r_ - 0,47 , 

• ft!, • . ^ ' {Battle.^ 1966) : " "Z . 



VALIDITY (continued): , ' . • 

Concurrent In a town, of '28;000> a sainple df seventy- 
four seventh, eighth, and,nint}i graders wag drawn; i,t was 
distributed in the following v;ay:/ ^. ' ^ * ^ —v , 

" 20 Minima^^ *Goai ^ = - E^ectancy* 

20 Minimal Goal ^ .Expeetaric^ \ - ^ 

20 Minimal Goal ' <; Expelbtancy/ Attainmenjt Value 

. ; • ' . ' High'- , ' ; . 

14 Minimal Goal ' < Expectancy, Attainment Value 
. . r • Ldw - . ' , • 

In this s^ple,* Expectancy correlated 0,47 ^nd Minimal Goal 
Certainty correlated *0.42L .with persistence in art experimental 
math' task. , Mihimai Goal, Absolute Attainment Value, and. 
Relative Attainment Value did not predict task persistence 
(Battle,Vl965).' • . ^ 

Predicti^ve , See Table* ^ont following* page^ 

- . ' , ^ • : 

RELIABILiTY: ^-BecausS each cohstriojct is* measji;ij:ed by a * single " 
itemV in terhai -.consistency knld' alternate form 'reliability 
are irrelev^t boncepts.^ Testfretest ^Reliability -'^S irre^eV^ant 
because test is ^upjJose^d^ to bd sensitive to Vhat, Kappens'^'in^ ^ . 
school. Rater reiiafcilit^^ .is irreldyl^t bed^use' aaswers^ are ' * ; 
preceded;. ' ' ^ 



A' 



SOURCE.: Battle; 1965, 1966i (basic items outside of original, 
formati^"^ , ' • ^ 



REFERENCES: 



• Battle^* Evt*. Motivatidnsal determinants., of /academic \task;. . . * \^ ^IJ* ^ 
lpei;^si$.tehce. Jburtiar of Personality ^ and gocial .Psycho logy /> V 

\ l^^y : ' .\[^ ^ • * r« / ' - :^'v^^'- "^-^'-.'^^ ^>i^*^'J ' ^-r'^'J^'^^^^ 

\^B^H:tie', ^^F. 'iwotivationsl determinants" af a'cadeMc cp;ilpf^, 
V^eHce, JOu^n.al of. Pe^sonaMty ,and Social^^PsygKolc^gy , ^i^gg^^^^ 
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" BROWN 2;PS SELF-CONCEPT* REFERENTS TEST '* . 

BEHAVIOR MEASURED: Self-concept—owti' and^perception, xxf/. 
t^acberl^ image of hiin op .herself:*'^ . ' ' • : 



AGE-GRADE -BS^GE: 3 1/2- grade 3 . 

ADMINISTRATION: Individual^ ^ oralv ' Tes^: is* untlined.. ' ' 
\ ' * . " , ^ • . 

.OPERATIONAL DESCRIPTIOIJ: Full-leagth picture (polor^ takep, 
of^ child- as he* stands a^^ainst pff-white^ baCkgroundV No . 
posing instructi-6h» given.. Aft^t' recognising him or iierself 
in th-e picture, the child is^, asked -a stari4a^rd^zed set.af; 
'15 qilestitons ab6ut characteristic:? of the. person iry 'the'"" - ^ 
picture.^ Questioits *ar€i in :"either-o^'j format*'Sp that ^ 
bipolar; characteristics of various' dimensions ax^ represjsnted.V 

-For example, . "Is. ./child's name! >appy cf^ is-he^ sfd?" For * ■ * 
chiadrqn attendirng school, the^ same ^15 questions are then' * * 
asked from, fche tea'chef ' s ^jpexspectivel* Fox',exampi$/ "Doe af 

' (Child' s) teacherr -think that (fehi-ld' s. nam^)* is^tiappV^'or.. , 
that He is^sad?" ' A^t the**en<J, the •child' is giVei> 'andthe:^ • , 
£>ictu2:e-'bf himselfs^to take ^$ome.'./(WhiT.e pVow inolud^d.-^ ; 
.-•'other kids^ perceptapn in ^anpther ''set 'o^* questions, the ?' 
Manual'j [Eduqational Testing Ser.vice'>/19695 does i?bt,] \ r 

FORMS:' One* , ' ' *' " . * ' . '"'^ \' , 

•NORMS.; ' Satmple was composed of 4,4 children, mean'^va&e 5. 7. , - ^ 




f oijowing p^ge. . ' // ' ' \ ' . ^. J , ./ A 

2^9 ther 'Sample consisted, of 1851 child:^§n parti.<5!.ipa'tiBg 
in the ETS-rH^adstart Bqngitudinal Study. (Ddjicatiqnal. . r ^■ 
Tesjtij^g Sexvi:<:A, igYoj.. They Vere., tested, at ag§- fpur.'ptiqr ; % 
;to sdhool attendance. .Becaxase children this ^age hSvq ditfi-* ' 
.fculty .understanding' the difference" batv;efeh 'se'lf" ai}d, bthe'r, -w V 
joefef^ntSj' ofily scoriss iref'^rrdng* to the ehiidjs pfcrdeption 
o'f self . aire rep(?i:tedi, ' meki =^ .Itf.'e-, SD-^^ .^. r.. (These- 
scores are posi^tiveily skewed. ) ' n ' ' • ..- ;'. ' " - 
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VALIDITY: « . . 

^ ' . Content , /'The test's ratipnale uses Mead's notion 
of the evolvement of self-concept from one's perception 
of significant others' perception o'f self." '{Educational 
Testing Service,. ^19 70 , Vol. 1, p.. 177)^ 

Construct . Brown (1966) gave 38 lower class black and. 
36 ^middle class white children th'^ same 14 bipolar questions which 

.were repeated for their mothers', teachers,', and "other kids'^ 
^efceptions of them. In that study and a later replication. 
Brown 'found black children '^s self-perdeptions were signi- 

^ficantly less favor^l^le than ^those of white children* . Black 
children pprceived their teachers as seeing thefa in less 
favorable positions, (Nq difference 'between the two grov^)s 
in either their perceptions * of their'.mother 's jorr 'peer's, 
evaluation of th^ra.) No race differences appeared in the 
^)TS-He$dsta?:t study (Educational Testing Service, 1970). . 
^ In the ETS sample, self-concept scores were no different 
feof males* and females. The'r^ was a ■ significant relationship 
between age and numh^iLjof omitted items:' the youngest 
children (42-44 'months) omitted an average of 2.10 items; 
the oldest .(57-59 months) an average^ of 0.42 Items. Art'i- 
factual variables ^may h^v^ entered iiito^the response to 
cfertain.. questions • '.For exaii5>l.e, subjects had. less difficulty 
responding to items using opposite adjectives" than ;tp those 

,us,ing ne^gativ^s. . - ^ * ^ ' ^ v ^ ' ' " , 

RELIABILITYt -Internal consistency - In Stanford Research 
Institute saAple *descri)Ded above J ^Kr20^ 0. 72. 



.^SOUKCfeV Educationa!^ Testing Servide 
, ^ ^ .Pfi-iiceton, New Jersey 

REFERENCES: 



Educationa1^Tes£ing .dervijce. ^ Disadvantadfed' children ^nd , 
't|ieir firsl sg|ioo1 ex|)eri£nces*: ETS-Headstart Lbngitudina 
/Sltudy-i 'Vol. 1, ,Prificeton> tNe^ vTers^ey, 1910/. . 



•Manual- for test a"dministration: Brown JDS SejLf-Concei5t 
Be.ffe^fents Jest.;,* Educa£i©nai* Testing Service, Princeton, New 



^Stan.fp.rd Refeearcli* Ins|^*tu1;3. Repor^t of thei pilot studies for 
/'tfife Follow Through e^^'^luattcgi /•\'J'al 1* 1971' tes^t/ battery • , / ^ . ^ 
•>IfenJ.o.-Pal:Icv\tali'forh 197i/ V— ' « ... 



SUBTESTS OF THE " . .. . 
CALIFORNIA -TEST OF I>ERSONALITY" ' 
(SjBnse of Personal Worth and Antisocial Tendencies) 



BEHAVIOR MEASURED: Mental health—personal and social 
adjiistmiBntv 

AGE-GR7UDE RAl^GE: Kindergarten to adult. 



ADMINISTRATION: Group administered, written test. Maximum 
of 45 minutes for whole test; lantimed. '' v. 



OPERATIONAL DESCRIPTION: Child answers 8t 12, or. 15 ^ 
(depending on age) yes-no questions for each s\ibtest. " 
IB- Sense of Personal Worth is part of the personal .adjust-* > 
ment battery; 2C- Antisocial Tendencies is part of the social 
adjustment battery.' 



FORMS :,_>A^ and BB^ ^ ' Dif-*erent test booklets for grades 

grades grades 9-college, and adult.' (There 'id also an- : 

Intermediate booklet for grades 7-10.) 4^ ' 



NORMS: The Standardization sample represented, every g^gra^ 
phic area of the U.S. . . 



Subtest 


Age or Grade 


Niomber 

■ i 


■ 

Sjdbre at 50 th 
^^■ircenti le^ — I 


0 IB 


■ K-3 
4-8 
7-10 

9-L4 * 


4,500 
4,562 
2,812 

> 3,331 ■; 


6/8. 

8/12 

; /i i2/i5' 
12/15 


2C . 


K-3 
4-8 
7-10 
9-14 


■ 4,500 
4,562 

■< ^,,B12 ' . 
■ 3,331 . 


. J 

4 M 8/12 

"m'-tv-i5. 

12-13/15 ^ 


' .V • 

. ^ 149./ , ) - ' : ' ■ 



* . 'Coht^rA. "Th6 ofirgi-nal soiirpes. of the iteifts./ .were 
;t6e put>Iipations, of'^psypho^ogi^ts an^d origin a^^^rpsearch py. 
^iiet^^)jkh6rs. ^ The specific adjustment: patterns v^ich^.they ' 
h^Td to 'be th,e b^st indiqatbrs p£ .adi^^stment ?6r lac^ of it)'* 
• were • spigoted fjfoEi this literature as criterra of adjijst- ' 
iQfeht*\i' Hqweyefry since^ the^d^ ps]gchplogists w^i^e *n6t.*ih, : . , ' 
agfreemen.t on .many points, five pther educational and five* 
,6t5ier' clinical psychbiogis€s were given the', task of ^judging - 
the appr,6priatenes^s' kiid eliminating the least desirable q$. 
these criteria," (Thorpe; • Clark^ and T^^egs/ ]y953, p, 7X,^ , 
^ 'J * Test: items were devised* to% cojffespond to. thfe surviving;- 
ctiteri'a on' each' of \ifipVe age, levels. ^ ^ , • ^ , - ' 

\ S6me. of the subtests have outdated dontent. !phe^* tv;o 
stib.t'ests de'scribe.d here, were chosen because both cop tent, 
a^^^'^correct answers' deemed, reasonable at the present time. 

» ^ * ' ' \ J • ' . • 

Construct . iThe intercorrelat;Lons of subtest scores 
within the Personal. Adjustment' area orange from*. 0.27. to 0.58 
for^ children in grades 1^3 <N=237). For the Social Adjust- 
pietit area, the fangfe is ftom 0.18 to 0-c58 (Thorpe, Clark>. 

.ai>d Tifegq, 1953t. • \ ' \ * i 

Concurrent . The. California Test of Personality Was . 
fomd to correlate more closely with clinical findings 
;|aian any o'fcher personality test (California Test Bure.au, ' 

ii949). ' * . ^ . . ^ : 

f " In a^ coipparison of the test witJti ttjree rating methods . , 
^<Uid ah interview^-tfechnique, the California Test of Personality 
was most valuable in 'minimizing peirs'onality variance within 
.individuals (Jackson, 19.46 )^.\* , ^ ^ . - ) * 



iR!ELIABILI?PY: > * ' , . . 

Internal consistency . IB- Sense of Personal .Worth, was 
selected because it has the highest correlations, with the, 
total personal, adjus^tm^nt score, (0^71-0. 82*) ..of any 'stabtest 
with«mod^3:n content* Similarly, 2C*^ Antisocial Tendencies / 
,has the highest correlations with the total social adjust- 
m6rit score (0.66-0.1B2) of any subte^st with mo4^rn content^, ^ 
The. correlations of the two subtests with each other, §re 
fairly lov, ranging from 0.33 .to 0.36 (Thorpe, 'Clark,' and 
Tiegs, 1953) . * . ! : ^ " ^ \ v 



RELIABILITY (continued):' % / ^ . 

. Alternate fomgis , "Tor al^ levels, the' items of ^ each 
component, . .havfe been made Equivalent .by tfi§ p;rqcess of 
having each item of Form AA matched with ,an eqviiyalent 
item of Form .BB as to difficulty., <|xscriminative'^ppVer, . 
and internal' consistency. ^Thus*', the means and standard 
deviations ar^ identical and' the, [otjier? re:j.iabilij:y data 
appl^^ e<jually to Forms 'AA and-BB." (Tliorpe, Clark,, akd 
Tiegs,. 1953, ,p. 4) . J • / ' ' ^ 

« . ' ' ' ' - • 

Test-re tes^t . No in formatiorj- about the" Jzilne interval* 
/between test and re1:est was^give;! when tite ^ following 
reliability coef f ici'ents' were deterihined: ^ ' - 





Subtest 


, Age or Grade 


Number 


'K-R {20) 
..'Coefficient 




2B 




255 " 


,0.^2 


1 




4-8 " . 


'648' ' . 


'0.64 






7-ia : - . 


1136 


0. 7*5 






g-14 ' , . 


2262 

4 — U 


0.77 ' 




^- > - ' 


K-3 ■ 
/ 4-8 

■7-10 ^ 

• ' 9-14 ' 


648 
11*36 
2262 


^' 0.82- 

' 0.77 . 
, . 0.86 ; 
0.84. 



SOURCE:. California , Test Bureau 

Division of McGraw Hiltl Bo'ok "Company 
Del Monte' 'Res ear di Park ' • * 

• Monterey, .California 939 4jb'* 

* * 

REFERENCES: ' . ■ ' - 

■r 

California Test Bureau. Sximmary^ of inves'tigations nuiriber; 
one, enlarged edition, Los Angeles., 1949. . . / J 

* ,Jacks6h, J. The relatiy.e e Effectiveness of papei^-pencil i 
;,test^ interview, and^r^tin^s ' as teehjijlqui^s for personality 
' evaluation. Joiilrn^al'^of Social Rsychblogy , 19 46, 23^, 35-54' 

Thorpe, L*P. . ci^^K,/-WrW. , 'and Tiega-, E.W. ' Manual: ' 
Calif prnia '^es.t o.f Personality . Monter^,"* California: 

• CTl^/McGrawrHiU, "1^53^;^ ;. ; v \ • \. . . * 



- ' CO'OPERSMITH SELF-llSTEEM INVENTORY 

Behavior MEASURED: S^lf-concept*- self-esteem. 
AGE-GRADE -WQE: Age 8 through adult, ' . * 



ADMIRlSTRATIOlJ*^ Group,, written. Untimedj no time given, 
bj[it probably about ten minutes for Form A/ five minuted 
for Form B. / - « / 

^ OPERATIONAL DESCRIPTION: ' Form A a list of 58*-items for 
which subp^ctv checks '"like me" or "unlike* me". Items broken 
down 'iiito^ 5 ^ubsbale's: gfen^ral self, socia*! self-peers, 
hcMne-parents, 'social-academic, lie ^cale (8 items). Form ^ 
B 25 items having higjaest , Item- total acore relationship 
in Form' A. Fbinn^ ^as- no subscales (Coop^rsmith, tmdated) . 



F0RM6: A artd^B./ 

0 

^9RMS: 



sample ■ 


Age or Girade 


•■ Meari'% 


■ ./ 
SD 


\43' girl6*. 


-Grades i5-6 


",83. 3 . .;. 


. 7 


44 .boys * 


Graces 5-6^/ , 




• 12.2. 


r>748 school 
"fchiJLdrfeh in . 
c^htral^ 
Connecticut^ : 

' "Girls' V \ 

••\Boys •' * 


Ages - 9-15 ; 

a 

; : ^ ' ... 

' . * ' . 

^1 ' t 


12:% ■ 
'.70.1 


** 



4 



(Coo^e^rsmitiiv^ 196^^ 



4 ' Of 



. 152 



VALIDITY:" ' ; • , ^ * ~ . 

Content , ItemS reflect personal judgmeats of worthiness 
in four areas:, peers, parents, school, and personal interests. 
Five psychologists sorted a pool of items into two groups — 
those indicative .of 'high, self-esteem, those indicative of 
low self-estefem. Repetitious and ambiguous items were thus 
eliminated, 

,^ Construct, Children from higher social .class backgrotind 
have signglficantly higher s^lf-esteem, Jewish children 
expressed higher self-esteem than Catholic and PiKDtestant ' 
(Rosenberg, 1965). ' . ' • . 

The following findings are based on 85 children from ' 
. Cooper smi th * s standardization sariiple, systematically selected 
to represent different levels of self-esteem. Children of 
father^ with irregular work history are most likely to have 
low self-esteem. There is a significant ass'^ociation of . • 
mother's self-esteem and stability and child V? subjective 
self esteem, ' ' . ' ^ ^ 

"The mothers of children with high self-esteem are more 
self reliant and resilient in their attitudes and actibns 
concerning maternity and child care* ^ They aa^e also 
more likely to accept their roles as 'mothers and carry 
'them out in a realistic and effe-ctive mahner, , .« 
Fathers , of high self-esteem subjects*, are^ more likely 
to be^^ attentive ajid concerned with^their sons and, , ♦ 
the* sons ^are' more likely , to corifid^ -in their fathers, 
./'The interaction between husband and, wife in the families 
. ' of childteh with high self-estfeem^ is ^marked by greater 
. compatibility , and ease than, is the case in the families 
^ . of children- With less, self-esteem. There ^re more 

instances of previous, marriages and' rearing by step- 
' \£a^ent^. iyi ihe- familieS| 6f low self-esteem children.', , [ 
From evidence on .^tK'e decision making process employed' 
* . within the fainily/ we .gain the impret^jsion that the'^icfh . 
self-esteem fafailies establish ?cieai;er ' patterns of 

authority an,d areas o£ re'spbnsibili^y, " (Coppersmith, 1968 

j - ^ - . ^ • . \ ' *^ il6)'W , 

,^^The- most general statement about the antecedents of.'' 
^ Welf-e§teem c^n .be ^given' in terms' of three. conditions : 
total or..iiea;6ly total .acceptance o^ the phildren by their 

. parents, diearly .defined ain^ enforced limits , and the 
respect and latitude* for individual acta cJn ,.tW exist 
v/itriin ^the defined; limits (Cpoper^mith,. 1968, p, 236),, 



VALIDITY (continued): , v . ' 

Construct (continued).. , ' 

' . , . • / 

"Self-esteem is' higher among first and only children,.-. / 
Children high in self-esteem are less likely .to have 
experienced frequent, nonserious problems during the 
early years of their childhood," (Coopefsmith, 19.68, p. 16 

•'■ ' . ^ , * ' ' y ' 

' Mother's certainty about method of feeding is associated with 
' hi^ seif-es,teem. Children with high self-esteem, ar^ less 
likely to have been "loners" in their ::.chi1Ldhood and a-re more 
likply to have had good relationships with siblings and 
peers (Codpersmith, 1968). . ^ \i 

Concurrent . The following associations are not based 
on the calculation of correlation coefficients, but rather, 

statistics from contingency tables.. The sample is the 
same as above. 

•"High self-esteem is associate.d^^i th high IQ and medium 
grades, tiedium self-esteem is ^as^ociated with High " 
;grades . High self-esteem \is. -a^so , associated with 
/,^10w manifest anxiety, a Iqw^eVel'of destructive 
/ /behavior^ and high level of^spiratiqn (beanbag. measure) . " 
(Coopefsmith, ' 19 68) " ' * 

RELIABILITV: \ * ' " " ; V ' 

) Alternate forms. - r==0-. 8©^' ? - . ' ^ 

^ ^ ' " . " f 

,;r ^est-retest . Five week interval; 30 5th grage children, 

rf=d.'g^f7^^ Three year interval; 3A children tested in grades ' ' 

5 and 8^ r=0.70; 

SOORpBr Coopersmith, 19 6^4r u , 

Cooj^ersmith, S. 'The antecedents 'of seXf-esteem . San '\ 
i*rariciscD, Freeman,. 1968; ' ^ ' ^ * • ' 

Coopersmith, S; , Instructions for scoring and^ interpreting 
the s'eif-Este*em Inventory, University ot California, Davi^, 
undated.^ . ^ , ^ 

, Rosenberg, Vi. Society.. and the Adole^Qent Self-image. 
Princeton :^ ' Priftcetbn University Press, 196*5. 



CRANDALL'S INTELLECTUAL "achievement RESPONSIBILITY SCALE 

BEHAVIOR MEASURED: ,-Locus of control (extern-al vs." internal 
control, of events) - in the intellectual-academic domain only. 

AGE-GRADE RANGE: Grades 3-12 



. ADMINISTRATION: Individual oral administration for 

Grades written administration in group for Grades 6-12. 

Un timed; average time not given. 

OPERATIONAL DESCRIPTION: 

Child is asked to pick the answer that best 
describes how he or she feels in 34 forced binary choice 
questions* concerning the causation of positive or negative 
outcomes in the intellectual-academic domain (Cran^dall, 
Katkovsky, and Crandall, 1965). For example: "If a teacher 
passes you to -the next grade, would it^ probably be r 
(a) because she liked you; (b) bec^xa^e of the work you did." 
; Answer (b) is the Internal Control alternative • 

E0IU4S: The following'^research refers to the original 

34-item form. There are, however, two newer short forms 
(20 items), one for Grades 3-5, one for Grades 6-12, These 
eliminate items having the lowest item - sub'scale point 
biserial , corr,elation (NIMH Progress Report, 1966-1968). 

■ . I- 

NORMS: The sample was composed of 92 3 elementary and high 
school students drawn from five different schools: a consoli- 
dated 'coxmtry school, a village school, a small -^city school, 
a medium city school, ^nd a- college laboratory school* 
(See Table . , on following, page, ) 

V ^ ' " 1. . • . ; ' 

VALIDITY: ' ^ 

Content/ For each question, one alternative states thait 
the evfent was caused by, the child and another states that the 
•event was caused by the behavior of someone else in th6 child's 
immediate e|ivironment. Becavise there. is no evidence that 
beliefs 'about locus , of control 'generalize across different . 
behavioral are^s, the , Intbllecttial Achievement Responsibility 
Scale limits ; it^ems to the singl^e domain of - intellectual- t., 
academic achievement. Th? scale was con^^tructed to sample '^^ an 
!equal numberr^pf positive and negative events, so that separate . 
subscores ci^j) be obtained for beliefs in internal respohsibility 
for -successej^ and failures*. 5^. 
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VSLlblTY (continued) : . . , \ > • , . 

'l ^ Construct, Correlations ^between the I.ntel'ikdtual ^ 
Aqhievement Responsibility subscoreq for po^itiye ^nd' \ . ' 
negative outcomes are 'positive but low, achieVrng .'signi--:,.^ ? 
fipance in grades; 6, 8, and 10% but not in /grades ' 3-5 or 
12^ Social class accounts for^a rauph smaller rprc^ortioii . . 
of the variance in Intellectijai*,Achievement 'fe'esponsrbi].lty ^ . 
than it does in other measures of locus of .qontrpl . whifch ^ \. 
sample a wide range of social experiences, not,- 5^5=^st\,scho61-- * 
associated activities. Correlations 'with lO {L'okge'-r:^^ / -''^ ^ 
Thomdike and the California Test of Mental Matiority)! wer6 ' 
small but statistically significant. ' *" ; •.•^ t :"' 

Jn grades 6-12 Internal Intellectual Achievement Respond 
sibility Scorers were significan^tly associate'd with being 
first born In a family and coming from a Small' family . 
To assess "social desirability? (the tendency with which 
children will dissemble in order to put themselves in a 
socially desirable light), the children's li^R scores 
were correlated with their scores on the Children ' s .Social ' 
Desirability (CS&^ Questionnaire (Crandall, Crandall, 
& Katkovsky., 19^4). An absence of relationship between 
the^e two measures would suggest that lAR scores are 
independent of social desirability tendencies. 
Social desirability tendencies do not account for.jnuch of 
the variance in Intellectual Achievement Responsibility 
'scores (Crandall,^ et al. , 1965). ^ 

In a sample of 40 first, second and third graders, 
girls scored significantly more Internal on the Intellec- 
tual Achievement Responsibiliti^/^ale. There was a '-^ 
correlation of 0.38 in the t^^^al sample between this score 
and the child's intellectual attainment value, t1iat is, 
the relative importaiifce for the child of intellectual* . 
achievement 'in comparison with other kinds of achievement 
(CrandalL, Katkovsky, and Preston, 1962). 

^ Congruent . In grades 1-3, Stanford-Bine t IQ and 
Intellectual Achievement Responsibility scores were highly 
cor.re:i.ated for boys but not gi'rls (r=0.52, n=20') . 

. , Concurrent . In grades 3-5 Internal Achievement 
Responsibility scores correlated positively and signifi- 
cantly with almos^t all parts of the Iowa Tests of Basic 
Skills (reading, mathematics, and language sub's'cores 
and total achievement test scores) and with report card grades. 
In grades €--12, IntejLlectual Achievement Responsibility 
co:^related less strongly but still positively with grades, 
but most of the correlations with the California Achievement 
Test were not statis.tically significant (Crandall, et al., 
1965). 
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' between r-In^grn^^ InteiiecHiisl, A V/. ^ , 

* ; geisppiis*ib^;l'i.ty S c:a:le spef d^rand ^fcsc)rr$ctn.e's on iJh^e . * . * , ' 

'^^ilpTL- 'a.-;^ainpie ^,pf ^ .0 f ir? .t / s fe*boridr,i;&nd' tfiii:d!tgyad'6a^ , , ,>degree ^ /" , ,: ' . 
*Sf jtntexnal^'Rs^ ' ..." 

Ind pu:ppo.se^^3Jles,^y//a^^ ' ... 



.\ ^ /^om s^ibiiriits/ tgf [whole, 'vs'../.',txiai >nd jgolv^-ng a.'' 

JrI>^^Chi^ ^jfeepc^'t/ ; 1"9^^^^^ / 

. ^In-telle^tual . Achiiev^fnen we;re "liijghly " 

' 'c6'rrelatea wXtl?. • . ' / 

to speAd in inteli'dc.^ai ap^ 
. '(£=0.70) and the; intensity; witH:w^ .* 
^ .m:*: ' --thfese at:tiVit£es/:(^0».66)", , ' They ' we.r#;jaX^p ' ' . - 

. cptrelated with boys' reading achie^v'ement te^t ^^or^s . / 

i",. ': . V /{r=0.*$i:) . ^ These, correlations'; were not:.sign:ificant-'''for , ; / ' 
; V • ^girls- tCrandali, et alJ, 1962).-'- . - ^' ^ " / ' 

' • ; RELiABI'LITY: ' 'Standardization sample XC'randal],> Katkovsky,. 
V . and Crandall, 1965). e 









.Coefficients, . . 


Type 


' 'Grade ' ' 


Number 


Total ' 
Scores , 


Positive 
Outcome 


Negative 
Outcome 


Test-r^tes t 
(2 iftonths)' 


• ' «. * 
'Grades '3-5 
Graeme 9 


47 

70 ' 


r=0.69 


r=0,66 
r=0.47 


r=.0.74 
r=0.6g 


Internal , 
Consistency ' 
(odd- even) 


Grades. 3*5'' 
.Grades * 6/^8, 
• ;iO, 12 


: 130. 

^ :130 


r=0.60 ■ 


r=(>. 54 
r=0.'6p 


r=0.57 
r=J3.i60 



SOURCE r Dr. Virginia Crahdall 

Pels . Research Institute ^ 
Yellowsprings / Ohio 45387 



^ -^Although trie authors talk 'about "predicting".- fr^pm the\ / 
indefpendent to the dependent variables/ the £ime interval 
between them is not' specified/ and. they^ may' actually be 
concurreht measures.. " ' ! . 



158 



rERic 



"CrtiTfdal)i-jj>rC:> KatJcovsJcy/ and CrandaldT; V. Children's 
beliefs^-irx th.eir own, control of reinforcements in intelle'ctual- 
academic achieveme-rit situations, Child Development ; 1965, 36/ .91-109, 

Crandall/- V. J.s^Katkovsky , W., and Preston, A. Motivational-^ . . 
„ ana- abilLty determinants of young phi Idr en' s intellectual 
. ^ a^ch|evement behaviors. Child Development , .l'9'62, 643-661. " ' 

- , - . < - 

" 'n|^^., Progress Report,, Grant No. MHO-2238,- National Institute 
q-f Mental Health, National Institute of Health, -1963-1965. - 
.,pp,UlO-119 and 1966-1968, ppj, 66^67. • ■ 
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^ e^HY SEQUENCE .TPftSK 



' * - ' ' ; BEffiiVl'CfR MEASUR6dW Verbai , s'kills, -comprehension (Part ' I ) , 
' . ^> etnd, imitation (Part tl) of 'narrative; visuaX seguenci'ng. 
■ -V (Parts III and lyj/:- -f-v ' ' v - > - ^H,- 

AGE-GRADE RANGEi ^Ages 4-8'; (upper limit .is^ que^s^tiQnable !a^ 
'^thijs has no.t" beeh established) \ . \ 



?lDMINI^TRATION: ' Individual, oral.* Untimed; 15 ^minutes - 
(Part I). ' » * • ^ / ; v .^ -'-J' 



pPERATlONMii DEBCRIRTION : Tlie .mat er jlals ^ cons i s^i*of j^'six s e ts. 
b£ "Cards wil^h dr^awXngs o£ animals in various' ^i'tvij^tion^S • ' ^ 
/ >Ther6 is no, apparent /secjue^de in the ^ictureS. sitCi^tioAS-- ' 
. the sequence is provi^ed^'by 'tlie' verba'l cues "used ^ ih 'the\ 
/^-.•stories/ One '(.Educq-tiofial Testing Service^ ,19 70^,; or thj^ed. 

(Tanaka.e * 1968) other sets" ig vised for-, instriuctional Ijurpo^es^ 
' ' ^ ^ The first part ^ is a coir5)reh^nsi'on' t*est arid reqiiires'. 
no Verbal '^response'. 'The child is presented yit^i an a^ta^, 
.of -idiree or /four picture, cards', ^ahd , he is , ask^dVtp'^ select 
a sequence ^pf Ca'rsds to go witfi a s.tory he is'li^aring. 

In the^seconci piart, the child Us, tens to a: story and 
Ul'^^ ./the^^ -recalls, i. ^. ^ 'retells, , the story> - . - 
^v;* lA^.the third part, the ehild produces 'Ms own*, 

j's-ele^cting and ordering cards from an array (Shipman, 1970) 
J . V"^*'^^ also a .fourth p.ajct.--Of the. test, .'used by 

,'/Jy^ T?fn'e^ the ch,ild is ,aske*^-'to Choose on6 of three < 

/'l * ans>^^'r choices for- the, final card, needed, to finish the • , r 
•sequence* -Part IV involves four^mpre .s4.ts d£/ cards.)* . . 



FORMS: One. 



NORMS.:. ,i5ee Table on following ' page; 



• VALIbW:; /• : r-.^''^^ ^ , / v-- 5 ^ V 

Qpn tept . The test has obvious face Validity, but.:;*. 
' no disoSssIon o'f -item selection,ds ayai.lablei^-i :^ / 
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-'o^ . . ^;'Aj;^>:"^:1v^':ii'^^ • , v \"?V^>V - ^ 

.* • . * • S^^^i^^ r ^ S R^^-:':^^?^^^ . 'th^.^C^^^^^ 4i f f efence 

■ T- * ye.^^-oXas.)\^^' . \??lie, l^jte.at' iiv^J^^ of , this' siamj^lB >'e^d^4. helpi^ 
' ' ' " v-/-: 'xibeiiis ^ 'ik ;.S-harp . don t r asi: ; to*' a mpr e \. 

.5-^" r^V*:'/i>;^^^^^^ in Pairt il/^' \ / 

ages four and . . 
'•'ij/lZjiy^^ Tahle 7 X. 

'.J ' \-T%re^ jw^r^^^ . A^'^ fot' tiinei' words , middle- . ' 

' _ c%^B ;jp^ tH^V.l6weX'-class, ^gixis did better 

/ . ' ^ . "\ Z tjiari iHpv^s,;^^ did .better* than ' f ouft-y'ear-olds . 



\: '* ; ' In.texnar'c ; in the E^PS^Headstart Longitudinal 

••x> ' ■ coeffi- 

"^"^ * r^'^ • - items in Part I. 



. '-oient :fo2:,^1448.;chirdren was O.'S's ' for the 
' ^--1;= \., * ./-v•- 

* ,*.:'-i>-. Educational Tes.tingt;*Service 
Princeton*^ Ne^w. ^Tersey 



- ;iy V ''^^r: ' • ' ^ * ^ ' \ ^ 

\,. : EdiSpational.Tlestin^ Se.rvice,, Disadvantaged children and 

t^^eir first ,schbQl ex^e^^ ETS Heads tart Longitudinal 

; ;:S^^dy: '^Prel of the initial sample prior 

. * t6 school^ enrollment. Vol'. I and II, Princeton, New Jerse'y, 
1970. ^ St?:ucture. and development of cognitive' competencies 
cind styles prior to school entry, 1971. 

Tanaka, M.N. Time sequence task. Paper presented at the 
meeting of the American Educational Research Association, 
Chicago, Illinois, 1968. * 
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ILLINOIS TEST -«F PSYCHPLINGUISTIC ABILITIES . . ' ' •• : 

• •- ■• . ■ ■ 

Verbal ExpregsfSn Stibtest ' - , 

BEHAVIOR MEAiBURED: .Verbal sjkills --^ spontaneous sentence 
production.. ■ . • * / 



AGE-GRADE RANGE: Ages 2 1/2 to 9. " '\ r.' 

ADMINISTRATION: Oral^ individual. Requires about 5 minutes, ^ 
untimed. \ ' . . 

OPERATIONAL DESCRIPTION: The Verbal Expression Sxabtest , 
assesses the child's ability to express his* own concepts 
vocally. The child is shown four familiar ^objects one 
at a time and is askried "Tell me about this." 

The score is the number of discrete relevant 
and approximately factual concepts expressed. Starting 
point varies with age. Basal and ceiliwg levels are deter- 
mined by performance. " . . 



FORMS: One. 



NORMS: 



Sample 


Age 


Mean 


SD 


' Study 


Approximately 
1001D average 
children between • 
two and ten 


/ 2.7-3.1 
4.7-5.1 
8.7-9.1 


4.9' 
12.9 
36.3 


2.22 
'4.74 
9.12 . 


Kirk, 
McCarthy, 
& Kirk, 
1969. 


40 upper- lower 
and lower 
middle class 
children 


5.7 

* 


12.8 . 




Stanford 
Research 
Institute 
1971 



J 



^ , ContgytV ..- , "Qb5fiC:&^.:&.elected v/exe inp3:ei..i;>r less,, i^egular,. . ' \ 



' ^etwken. ^'-o* a^/f^iJ/lscjpxe^ si.gii^ifi6an,^^^ corfel.at^^ ^. 

■ €ons^tuet^ . Thi s" subtest correlate's Q'.^ 82 ?j?.itix tha, tpt:ai\ " ' ' 
I^PA 'score ^and p i 7'8/^^^ gxraqnma^ip, ,o 



Xba|e.d on .70|[.chxldferi/iri\the-19S9rl960;'s^ \\ . 

sgingleV .:^Gart^ ;a3a . . . ; • ; '^^^ v ' " ' 



... ■ ' Congruent ;'- This . subtest /ha4 a .cdrr^Iatibn^^ . ' 

!^ith Stanf ord-Binet St.^,f 0x4-^^ V. • . 

IQ (based brilsame: sair^^ KirkV;1963'):.^ \^ . . ' ' . 

R|LIAP;li^^^^ onf tfa.e ."^^ 

, 1'959t60 's.tanda^di'sia^d^^^ cphsis^^rv^ bf' 70!Q./Ghiltfren / w. 

bjetw.^en tv/p and nine,! rsuidomly. seiecj^ed f^om.^t^^ ^ /'..r. 

: s.qhop.i^ in., Decat^ur/ Illinois , and their prescKppl/^sibli'n^ . " . / V^' 

internal copsistency * . .The coegficifent^. ojf inteim^l/. '*'/'''V.;"X: 
'c6n.sistency is 0*92. The split--haif • reliability coefficifent \- . 

;is^-d-9i," '^'-/^ • ' 

"'^ Test- re, test ; Affce.r ag xn£eri;^al of ; thre^. :indhths^;pr ' / 

:inore,r r ?^0'..37 for ;the;.^ rahge^1frpih,:6--0 td^ V- * 

, 6r6^, . 69 ".diild^^ ,for the. .full/ 'ag4 ' ;/ % 

'•rangfe' is • Q.73'vi"-- "'"^J - v*-^- ' " v"' ' -^•'^ ''V r-.-^ -^-^ ''V:!" • 



'SOURCE: .. University of ll-Linois • pVe^s 
' : . . Ur'bana/ Illinois / 61801 



REFERENCE:' --y^ • . ' ^'^ • . 

J, - ' • . . • • ' . ■ • 

Kirk, S;A., McCarthy,' J. J* ,"' and Kfrk, ^ W.D. Examiner' s 
Manual: Illinois Test of Psycholinguistic Abilities . 
Revised Edition.. University of Illinois Press, Urbana, 
1968. ... 

Stanford Research Institute. Report of the pilot studies 
for the Follow Through evaluation. Fall 1971 tfest battery. 
Menlo_Ea^k,- California, 1971, ' - 
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It 



.V' -I 



I ;-'*:V'rv^-..!.6/ \ I-I/LINOIS TEST 0? .PSYCHOLINGU;[STIC ABIHTIE^- : ^ . - 

I*" :../r:;V' ^rT'V ^ ' \Graxgma£io c losure: Subtest > ^ • . ' ' vc' * " * 

|,;,V^^':i:''\.^,* BEHAVIOR K^SyifiEP: . verbal ^skills~producti<3)ri of grantaatical ^ 



'♦AGErGRADB SAliGEr^ Agfes..,2 l/i<Jco '9^../ 



4 :U 



^7 ^ * \/ ^^)^MINIST^ Iridividu^i^^ oi^ai'. ' Require^,'\^baut ,/f ive 

|>'/r'/; 'minutes'; Tintimed^ ' - yv .. , " • v \y ' ^ ^- ! 

IV'^^,/* '^'^ .OPBilATIOS^Xi DESCRIPT-ION: \1 G5ie,;.G^^ Clpsxire .Subtest' 

/ ."/V asseSse^Vthe/dhild^ abiM to make jase of the redundetncies 
, *^,o£ pral 'language In a9guiring\a,uton\atic habits for handling '/ 

'%ls^p^a ''flaerq ate 33 . .orally^' 

• ^refsenie'd Itejns accompanied l,by pid'ti^res whidh , portray -the . ^ ' 
' . ' i.'J content the '-verbal,.expre§|sijons V ^.,5ach yerb.al, item consists 

^V--**- ^ ^pw^et& sjbatem^ht ^followed .by ^ si:atemeh't 

I- \ v' ^c>. be -'f'ipri.sheS^by tW -child,..*' \startingjp6int ]varids with age. 
' \ ^ ' .B^alCkifid ceilingVlevels. ar^ .det^rmin.^d/by 'age. . * ' ,1 



WORfrS^; Ttie*stand^rdlza4:± 3g}npi0 ,,9pnsisted o'f 'approximately 



t-- t'Acfe'/-.- 


'.'J 

Meiaitx-' , 




•■'4: 7-5.lv 
0,7-9.1;: 


10-.'2 , 


'.■•2M'.7, 
. 3-. 39 - 

'3.ii 

* 



(iCirH., McCarthy.; Kirk, 1969)* 



vALiDiTYt-. r . ;:• : 

, Content. Berkd , ( L95,8 ) found. that young children could 
regularly supply' current Inflections to nonsense words.. 
Tharefoyef this ability.'- is- located .'at the non-meaningful 
level. Nevertheless, the ' if eg t' used pictures of "meaningful"' 
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and feund^liar because: bhildreij showed a tend^.cy,* to, \ 

n)33fee/n6nsens'e^'syllable^\ words^ ' I5i^\'pictu;res "pifovid^,. ' 
,sjupp9rt . to younger children But are.. h^t thought ' to be.,*" . , 
.'\infoi:m^';tive* ' v ' \ '^'/' V " - * 



^ Cbhstrupt, At ag^s. 6-6 arid t^^'O; only, scopes are Vsignif i- 
^cantiy correlated, with social qi'as^,-' Scoreslqn this . 
subtest correlktie :0, 9!0 wi.th td^al ITPA. sbbre,;'a,7.8 witft^ .\ 
the verbal expression 'subtest (based on VjiO .children, in 
'1959-1960 standardization s^ple, McCarthy, and kirki:^, l96,3>.. 

Congruent^' Thxs siabtest had a cqpcrleatiqri.of 0v?89 . . 
wjLth Stanford-Binet mental age X). 17 with Stanfdrd-Biriet / ^ 
IQ "^(same sample, 'McCarthy and* Kirk,. 19.63-).^ ' ^ . . * 



JteLIABILITY:. The following reli^ilitie^ are ''basfed on the 
1959-1960 standardization sampre^ consisting of 700 ' 
chi'ldren between, two 'and nine randomly selepted from those 
attending s^chool in Decatur; Illinois, and their preschool 
s iblings (McCarthy and . Kirk ; , -19 63 ) / f ' \ ' ' » ^ 

Inte^rnai consistency > ' Kjader-^chardson (20), coeffi- 
cient "ii~ar93r the snlit-^h'al^, reliability coefficient* is 
0.?5^ > / • "1 ^ 

Teat-retest> After an int;er\[.^l of three months or 
more/'' tp=0,72 within the restficled age range frqiti 6-0 to 
6-6 (69' children) • The estimaifce fhr the full age^. 'range 
is 0*92. : . , : • 



5pURCE: ' University of Illinpis Pfess, 
'\ Urbana, Illinois 6i801 



REFERENCE: , - ^ . • ' ^ • 

Kirk, S.A,, McCarthy, J<J, , ^ and Kirk,' W.D, Examiner's' 
Manual: Illinois Test of Pay^holinguistic AFilities , 
Revised Edition, University of Illinois . Press , Urbana, 
1968. ^ \ ' . / ^ 

McCarthy, J; J. and Kirk, S.A. Jhe' construction, standardization 
' and statistical characteristics of the Illinois Test of 
Psycholinguistic Abilities , University of ^Illinois Press, 
Urbana, 19.63. ' • . ^ \ ' 

' ' . ' "\s ' "■■ ^ ^ ^ • 
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j^EHAVIOR'kEASUI^:^ Concept formation - ^onyerb:ai.,ciassi^^^ 
catiohv • 4 -. V ^ • ' r ' '^[. ■ ' "^-^''^''^ ' - 

'AGErGRSDE RANGE:' Ages> 4-9* , * * " " : V'. 

ApMINISJFbvTIONj indivi<iual/ oral* Untimed; no, time given* 

OPERATIONAL. DESCRfPtlON: The test, pr.es en ts representational, 
as well as abstract items' indiyidu^lly on separate cards* , 
Each of 44 items of the test prefsents a matrix of 2 x 2 . or ^ 
2x3 squares. One scjuare is empty in each qaser the others 
contain two-dimensional geometric figxares or pictures of 
familiar objects which beoir some relationship to each other 
on^the basis o^ their appearance^* content, or spatial posi- 
tion in the matrix. The subject is expected tq. find the ^ 
figure or pictures for 'the ^mpty square on the basis of the . 
relationship established by the figures in the other' remain- . 
ing squares. He m^Jces his choice from among four figures 
or pictures presented alongside the matrix. The subject "is • 
asked to point to the figure that he believes to. belong, in 
the empty square. The 44 items are divided into^ four classes 
of problems. There is?*, no attempt ^to probe the child's 
response to any iteiUi / (Zimiles/ 1968)* . 



FORMS:. One. 



NORMS: The sample included' 320 children. 40 children 
.t20 boys and 20 girls) were tested' in kindergarten and each 
of the first three grades .of two public schools. One school 
was located in a mid,dle class neighborhood and* its. children 
cam^ frojn predominantly white middle class families. All 
children attending tHe other school were from lower^ class 
bla?ck families^ The, sanple was drawn in equal numbers from 
the upper, middle ajid lower levels of ability in thos^''gr^des 
ill which there was homogeneous grotaping. The resultant ndrms 
lird presented in I'igure 1 according to age and social class 
background (ZimileS/ 1968). 
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Grade Level 



a"= School A (advantaged) 
B - School B (disadvantaged) 



Class membership items 
•One-way classification 



dtems 



•-Two-way -el-assif ication 
items 



I ERjC : 
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VALIDITY: ^ . : / ; * 

Cont^j|t. Iteios,iallxin1;o ^our ,:clas'ses. a '\ ] 
(1) .:;?-d5:ceptual matchijlq i£ems (3) ^^-.present \a 2 x^'.2' 
matrix ^in l^^hxph the figures a,n all thrg,^.. occupied *.^qua^ : 
are identijcal| ' " \ ' * • * ' ' 

•-(2) |C3,,^ls' membership- 'items. (18) present,k 2: 7^ 2!.'< } 
matrix in ^wt^i^^h the. three occupied sguar^gsj contain different 
figures- that! Iiave a common feature. ' '\ \ jj. -v.' \ \ . 

(3) 0|ie-way classification litems, (j^l) pries en t • ' 
. oir 2 X 3 matrices in which all the members of eagh.col^umh 

or each row are the same. Thus the iden\ity^of the . missing 
item is given by its cdlumn or row member^ip. . ♦ " ; . / 

(4) ^Two-way classif icatipn items (12) present 2x3' " 
or 2 X 2 matrices J.n which row' and column membership, ' xii , 
combination, determine" the nature of the missing figure 
(Zimiles, 1968). • • 

Construct . There were no sex differences in the , 
standardization sample (Zimiles/ 1968). 

•Analys:Ls of incorrect responses on the one-way qlassi-, 
'fication tasl^ shows, that most result froitC failing to make 
the transiti^Ji from horizontal (rows alike) to vertical ' 
(Columns alike) arrays. . , 

Concurrent. Not available. 



RELIABILITY: Reliability data might be contained in Zimiles 
and Asch, 1967, bu:t Zimiles' of f ice . could not locate a copy. 

SOURCE: Dr. Herbert Zimiles ^ ^ 

Bank Street College of Education 
; New York, . New York 



REFERENCES: - . 

Zimiles, H. Classification and inferential thinking in 
children of different age aod social class. Paper presented 
to the American Psychological Association, San Francisco, 19 68. 

Zimiles, H. and Asch, H. The development of the Matrix Test. 
Document 1, Progress Report (1966-1967), Headstart Evaluation 
and Research Center. Research Division, Bank Street pollege 
of Education, New York, December, 1967. 
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. ■ : ^ fpTROPOIilTAN ACttlEVEMEI^y TEST 

/ (1970 Edition)" 

BEHAVIOR. MEASURED: Reading and. math achievement. 

, AGE-GRADE RANGE: Kindergarten through grade 9. 

.ADMINISTRATION Aim OPERAJCIONAL .DESCRIPTION: Group 
administered, timed, written. test. ^Multiple choice 
.format. The following chart shows ar east^^te sted at , 
"each grade -level and testing time for each. 



Summary of Levelt and Ttztt ^- • 



. ; * Levett 


Primer 


Primary I 


Primary n 


Elementary 


Intermediater 


Advanced' 


. Grades:* 


K7 




7.5 


2JS' 


-3.4 


■ 3.5-4.9 


' 5.0- 


.5,9, 


7,0 




Tests 


Items Time^ 


UemsTime 


Hems Time 


Utitis Tim f 


Items Time 


Items Time 


\yord Knowledge 






■ ^35^ 15 




IS 


< SO 15 : 


50 


15 


50 


15 ' 


' Word Analysis' ' 


39 


20 


■.;40^ 15 


, 35 








* 






-Heading^ 


33 


20 • 


42 




30 


45 - 25 V 


45 


25 ^ 


45 


^25,' 


Language 












5p' 30 ? 


ib 


SO 


90 


< 


Spelling . ^ 








30 


10 


"40 20 • 


50 


15. * 


50 


15, 


Math. CoropMtatidn 








33 


IS 


40. '35.-; 


40 


35 


40 


35 


Math« Concepts* 


34 


20 


e2 flo' 


40 


20 ' 


40 -25 .* 


;.40- 


25 . 


,40 


25 


Math. Problem Solving 








35 


25 


^35 30/ 


tS5, 






25 - ■ 


Sdence' 
















35 


'so" 


35 V 


Social Studies 














.93 


45 . 


94 





• Indmt^ grades for which each Uttcfy ft prUn^u ic tended. /At Frimer and Primary I l<veli. only a Total NUd^^tics score, 
*Ttme inminutei. based on both concepts and* computitipn* >ts reported. At tht. 

♦ lUfened to as rXJsteninf tor Swmds" at Pfimet level. Primer Level, Mathematics is refened to simply as ;;;Numbe^^" 



FORMS: G', H ' ' ' • ' .^^ . /• 

NORMS: Tests standardized on 2*50,000 pupils, in "^grades. K^^^^ 
throughout continental U.S, Report No, 8 (Test Departiftenti 
Harcourt Brace Jovanovich, 1971) presents nor^iative .data, 
for' every subtest at every age* level for every form.. . ' 



VALIDITY: ' 

Content, 



On the Jpasis of curricular analysis, items''^ 




ong the three subtests 
'^^64. to 0.79. For the 



were constructed to reflect j^hat was being taught in the 
classroom at the time of the 197X) revision (Test Department, 
Harcdurt,- Brace, Jovai^vich, Repag^h^i^. 1, 197^). 1 

Construct . Intercorrelatio 

of the Primer battery range from ^ 

other batteries they range from 0.60 -^0;89". 

Conciirren t. Correlatioms^etween Metropolitan subtests 

and the Otis-Lennon Mental ABi;iaty Test tend to increase 
'systematically up to grad^^;^*?^ Above ^rade 5, the cc^rrela- 

tions level off in the'^^ange of 0.75 - 0* 80 for both raw score 
' and deviation IQ (Test Department, Harcourt Brace Jovanovich, 

Report No. 12, 1971). (Median correlations for aach grade ^ 

are presented in Report Uo. 10, 1971.) 



REMABILITY: 

. ' Internal consistency . Median odd-even split-half . 
reliabilities ranged from 0.91 to 0.94 for nine different* 

age levels (Test Department, Harcourt Brace Jovanovich, 

. . 



•SOURCE: 



Harcourt, Brace, Joyanovichf ^Incr 

757 Third Avenue 

New York, N.V. 10017 \ ' ' 



' REFERENCES: 

^ T^st- Department, Harcourt Brace Jpvanovich, 1970. 
.^e^iort.No. 1, Content development; Report No. 8,.. Sxommary 
statistics for national standardization groups;^ Report 
,.Npv. 10,. Reliability , estimates and^ standard' ^errors of ^ 
measurement; Report Na^. 1%L, Intercorrelations among sub- 
tests; .Report, No.;* 15, Correlations' 'betv/eerv scores on; the 
Metropolitan Achievement Tests and the Otis-Lennon Mental 

• Ability I?est. ' . ~ ^ . 
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NOWIckl-STRICKLANp PERSONAL REftCTION SURVEY 



BPHAVIOS INSURED: Lolcus of controL (external vs. internal, 
.control Qf*-eYeJ5its) • v , . 

*AGE-(^^E 'RANGE: "^Grades^irer 77I2 (two ' sets of partially ' 
overlapping questions) . First and second grader s'.havje, some 
dif f iculty. . talcirig , te^ t • / >' / 

ADi^tNlSTRATION: Group a&Ainis.tered written test* Questions 
can' be 'asked* Orally or -in.* writing; yntimed . - / * 

PROCEDURE: Fprl^y "f 6r6^ed: ^c^jbice "yes"' or '"no" guestions^ 
such as, "Are ypu of beti/'blamid' for ;i:h^n^^ that just aren't' 
your fault?-" "bd y<3,u f^a;L /that d t ' g easy 'to get friends to 
do what you wamt^th^sm^^^^ pa:irft'is\ scored for internal 

control response.;) 



-FORMS: One' f or''eia<?l^' age TCan^e.; 

NORMS: The sample . cpnslltted' 6f_^l mostly, whitef students 

frx>m^four comunities* boi'dei^ing 'bn, a large;, southern .city 

(Nowicki and' Stjfickiand^; ^971) / . ^ ^ ' 



9 



Internal qrientation' Scy^le ^ 
Males «■•' f . ■ • ' !v Females 



'Grade Ntimber Mean ' SB ^-Nuifibibr' Mean . SD ■ ' 

3 44 22.03 4. 67 ]. 55 /''22.^'2 3 . 06 " V . 

4 59- 21.56. 3.58-' . . 45 " 21^'26 > 3^. 63 ; ■ 

5 ■ - 40 21.68 'J' .•38" \:41/ ,, 2.3.00 *>4.03.. . 1 

6 ' 45 • • 26 . 27 - ^ . Ife - f 3 ; ' '2^.»:.68 ,.4,.58 ■ ' 

7 65 • " 26.85 4.87 ' 5^2 ..r26T06-^:' 4 , 23'' " 

8 ^ 75 25.27 4.35 '. 34^ '27 .71 ■'3'.*58 - - " 
• 9 • 43 26.19 4.06 . ' 44 ' * 27.'7#;3.r5 \ ' • 

10 68 . 26.95 5.34 ' 5i7 . '..27^i02 '"':S:3l' v^-; - 

11 37 27.52 4,81 53- V.27 .99. . S.15 , . 

12 39^ 28.62 4:74 .,48 '27.63 ,5.05' 
^ ^ . — — - .: Mj/ r 

VALIDITY: ^ - I # - ^ . . ^ * . ' . 

Content . Items san^ple reinforcement situaltions .across 
interpersonal and moti^*ti6nal areas 'such a's affiliation/ 
achievement and dependeYicy. Readability at. 5th grade* lev^^L^ ^ 
and agreement on classification of answers were also criterija 
for including items^ (Nowicki' and Strickland, 1971) '. 



' VfiLIDITY (continued) . • . ^ 

; Con Struct 1 • Th^re is. a sirtall, consistent correlation 
/betweeri^,degr,ee-*bf Internality and occupational and educational 

l^yel/a£ *tihe,parfents . Scores are not correlated with Otis 

3?iitel%LjLgence (Nowicki and Strickland, 1971)\ In ^ socio-. 

me.tric/s,tudy of third, fifth, seventh, tenth, and 'twelfth 
. graders*, ''Ixi^terpal males received sigilif icantly more votes 

for;, clasps president than any other groups, while Internal 
•female twelfth graders were significantly more involved in' 
'* "Extracurricular activities (Strickland and Nowicki > 1971) • 

In a p^inp,- situation, 'Nowicki and Barnes (1971) found that, 

f or * adolescent black males. Internal scores were related to 

total votes received for friend and camp president. 
' Stri'cklalid' and Hill (►I&Ti). found* that a group of » 
' ei^ht to eleven y,ear did' males' with severe reading problems 

were- more likfely .to.. be\Ex.ternal than a matched group of 

nqriftal re^JSers. - /C' ' 

NowicK:i"^-*and Roxmdtree {lb'71) fpiind that, ordinal ^ ' 
' ppsi.tion* in family isX^^elat^d to Intertjal-Extemal scores: \ ^ 
"first bom . males , and- later born females are more ' Internal . 
. Nowicki and Barn qs*: { '1-9^71) pL'ncreased Internal Control 

scores , in d '^iroup of •29X" black* lower-class seventh, eighth, 
/and. ninth graders- by making explicit the connection _ between 

the* cfsLitK»^. 5 fie>ravilDr and.^res:iiltant rewards. 



' Concu^reDj> ^^*. -l^ * the ' ^standairdi zation sample, the' following 
correlatipns ljp,tv;Qen jLpcust of' control and achievement test 
scores w^re .found.^..' \ ' . ^* 



■ Grade- ' - 


•Nuiftbea?' ■ 


., Wale 


Numijer 


Female 


3 


* ■ ,34 ' • . 


.284 


27 * 


. .1.78 


4 s 


• . . 50 - . 


• .118 ^- • 


31 


.195 


5 


.42 ' ■ 


.398 


45 


.254 I 


6 ' • 


• . 33- • 


'•.27-2 


32 


• .112. 


^7' <. 


• :■ as •' 


.335 - 


34 


.306 


- 10. 


49. 


.442 . 


" ; 38 


.034 


12. 


> ^38 • 


.451 


48 


.004 



* (Nowicki and Strickland, 1971-) 

\:Iri a'm6st^.y ^'m±d)41e-class white school, Inte.rnal students 
4fJ^-t>iq^>igH'te»to ^eleven were significantly more likely to prefer 
a large- i;eward later to a small reward \immediately (delay ^ 
of reiliforcettient) . This relationship did not hold for black 



VJVLfblTY. (cpnttnued) ; ; , / , * \ ^ 

. Concurrent (continued) Z*. - ^ . ' - 

students in. a lower-class, schopl (Stricklaad, and JNbwicki, 
1971) • ^ _ ' ^ ^ -r^ ' 

\ ' In ar sample oT element axy sd^opr^cHiTdreA:, ,p^^ 

NovridJc^ (1971) fbpndfthat White External males wefe \. - , 

. significahtly more likely than Int_ernal males to distance^ 
black peers. The same ^results 'held for males and females . \ 
*in a high school sample, , . • 



RELIABILITY: Standardization sample (Nowicki and ;Strrckland/ 
1971) : • ' ' • 



Type 


Age or Gi^ade 


■- — 3 

/ Co efficient * 


Test-retest 
(6 .weeks )^ 

*♦ 


Grade 3 
Grade 7 . 
^ Grdde XO 


; ' ^ • s * 
T r=0,63; 
.r=0.66 ,5^" 
' ^ . ^r=0;,71 . 


Internal • 
consistency 
(split half) 


- Grades .3-5,/ 
^ * Grades 6-8 / ' ^ 
Grades '9-11 ' 
Gradfe 12 ' ; ' 


. ' i?=Q,'63 
r=0.68 
r=0*74 
r=0., 81. , 



SOURCE: Drs* Bonnie R. 'Strickland and Stephen Nowicki/ 

Emo3&y U niversity, Atlanta^ Georg ia. . ^ , . 

*' * • 

REFERENCES: ' , ' ' ' . ■ . * ' 

D\:^e, M.P. and Nowicki ^ S; Perceived interpersonal distance , 
as a functiori-of the subject's locus of control and the race , 
and sex of stimuli in elementary and h4gh school diiildren. 
Paper presented to the South-eastern Psychological Association, 
Meanu, Fla., 19^71. • ^ , ' 

Nowicki, S. and Barnes, J. Effects of a structured camp 
experience on locus o£ control orientation. Unpublished paper, 
Emory University, Atlanta, Georgia. 

Nowicki, S. and Roundtree, J. Correlates of locus of control 
in secondary school age students. Developmental Psychology , 
1971, 4, 479.^ 4- --^ [ 
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REFERENCES' (continued) 



Nowicki, and Strickland, B. A lopus of control scale 
for children. Tap^r presented to the American Psychological 
Association, Washington, ^ D.C. 1971. 

Strickland/ B.R. and Hill, J.' An investigation of .some 
personality Vqiriables- in, male children with s,evere reading, 
problems. Unpublished paper. Emory University, Atlanta, 
Ga. , 4971.* 

Strickland, B.R. ' and Nowicki, S. Behavioral correlates of 
the 'Nowicki-Strickland locus of control scale for children. 
Paper presented to the Am^rrcan Psychological Association, 
Washington, .D;C^.,^ 1971. j , . . ^ 
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OHIO SOCIAL ACCEPTANCE SCALE 

BEHAVIOR MEASURED: Peer interactions; — child's actual 
acceptance of and by classmates and^his perception o£ 
classmates' acceptance of him.' 

AGE-GRADE RANGE: Grades 4-9 (approximate) . 



ADI4INISTRATI0N: Coiiibination oral-written group adminis- 
tration (Lorber) . Un timed; no time given. 

4 

OPERATIONAL DESCRIPTION: The test. is made Cip »of six 
numbered paragraphs designed to describe a continuum of 
relationships from very close Association (1) to very 
definite rejection (6). Each pupi-1 of a group assigns 
^one.of these paragraph numbers to evefy other member .of 
the group (a class^ list must be prpvided) . ° The child 
then* assigns to himself the rating he thinks each , other* 
classmate would give him. 



FORMS:, Rath's original form is described above. A 
Revised Ohio Social Acceptance Scale a^eg^ai res ratings on 
a five-point scale. (The two most negative points on the 
original scale have been collapsed into. one. ) It has not 
been used to assess the child's perception of how others 
accept him (Forlano and Wrlghtstone, 1955? Justman and 
Wright stone, 1951). 



NORMS: 





Number \ 


Grade » 


Accepted 
(1-2) ' 


% Rejected 
(4-5) 




= 37 . 


. 7 


36 


30' 




37 


7 


33 


36 




36 • 


7 


46 


22. 




32 


8 ^ 


42 


25 




32 


8 


36 


> 37 


^ I- 

r: " 


~ -.30 


8 


40'- 


,21 ■ 



Tihese probably should not be^ considered norms, as independent 
observation indicated a tendency for a preponderance of 
acceptance ratings within a class to be associatd^d with normal 
dr;g6od class spirit •and absence of behavior problems. 



i'84 



176 



VALIDITY: J 
Content * -The content of the six paragraphs is based • 
f on information obtained from pre-adoles cents by asking 
them to describe activities they liked to do with their 
very, very best friends / with their other friends, etc. 
(Raths, 1943).. ' ^ * 

Construct . A special type of class featuring a. 
democratic, cooperative claissroom setting with individual 
guidance (at the ninth grade level) produced a higher level 
of overall social acceptability within a classroom than 
conventional classrooms (Forlano and Wrightstone, 1955). 

The test was found to reflect short t^rm changes 
in student relationships occurring during a trip. taken by 
a high school class (Raths, 1947) . 

After using the test .to identify ' isolates Freehs 
trained their teachers in procedures which! might help 
their social acceptability*-, Eleven of the twelve made 
gains on the Ohio Social Acceptance Test administered ds 
a post-test measure (Raths, 1947). * - 

There is good agreement between teacher's judgments 
of social acceptability and the results of the scale. 
There is also a relationship between social status and ^ 
social acceptance as' measuried by the Scale. In general, 
the results in a class]^om reflect the children's pre- 
vailing criteria of social acceptance, e.g., respect for 
athletic prowess (Raths, 1947). 



Concurrent. 



Sample ' 


Grade 


Criterion 


Correla- 
tion 
Coeff. 


Study 


41 suburban junior 
high -school s.tudents ^ 

a ft 


Grade 7 


Sociometric 
measure 


• * 


Young, 1947 
(unclear 
which 'form . 
of scale 
was used) 






Ohio Recog- 
nition 
Scale (repu- 
tation of 
childre^i as 
viewed by 
classmates ) 


rp=0.83 


f 


5 classrooms 


Grade 8 


Moreno ' 
Sociometric 
Measure > 

-1 


=0.89, 
^ 0.81 
. 0.78^ 
0.9^ 
0.89 


Justman & 
Wright- a\ 
stone, 
1951 



RELIABILITY: ^ * , - 

Test-retes r=0.72 far acceptance,. ratings ; r^O.77 for 
perception of acceptance ratings «(one-week interval between 
test and ret'est). ' / / 

SOURCE: Raths, 1943. , * - , 



REFERENCES: 



Forlano, J. an(i Wrightstone, J.W. Measuring the quality 
of social acceptability within a class. Educational and, 
Psychological Measurement , 1955', 1^, 127-136. ~ 

Justman, J. and Wrights tone, J.W. A comparison of 
measuring pupil stattis in the classroom. Educatilonal 
and Psychological Measurement , 1951, 11, 362-367. 

Lorber, N.L. .The Ohio Social Acceptance Sc^le, 240-243. 

R4ths, L. Identifying the social acceptance of children. 
Educational Research Bulletin , 1943, 22, 141-168. 

Raths, L. Evidence relating to the yalidity*of the o 
Social Acceptance Test. Educational 'Research Bulletin , 
1947, 26, 141-lf6, 167-168T~ ^ ^ 7^ . ^ 

Young, L.L. Sociometric and related techniques fpr 
appraising social status in' an elementajr^^ school., Sociometry 
1947; 10, 168-177 . > 
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OPERATIONAL :DES(:RIPTiaiJ: ^..Exdininer, s^ys/v/6rd^^n^^ asks,^^^^ ^ , 

to point to ^^ferjBftt;^*5^icture.'f^^^ ' ^ ' ^ 

(Older children, iridic^a.te ;pic^rie by-saying vn\^^ l\^^t.arting. 




NORMS:- a?he samp le cbnsisted o1& .4^ai2 ^ ^whit:fe ch ildren- ^ 

randomly selected from pub.lic ^cfiool population-, Nashville/ 
Tennessee (Dunn, 1965). ' * ^ 



/ 

^.^^^^^.A^c Levels 



Raw Scores 



17-6 to 18-5 
16-G to 17.5 
15-6 to lG-5 
14-6 to 15-5 
13-0 to 14-5 
12-6 to 13-5 
11-0 to ie-5 
10-6 to 11-5 
9-6 to 10-5 
8-6 to 0^5 
7-6 to .8-5 
6-6 to 7-5 
5-6 to ^ 6-5 
4-^9 to 5-5 
4-3 to 4-8 
^3-9 to 4-2 
3-3 to 3-8 
2-9 ta 3-2 
2-3 to 1J^8 



Foimi A 



• Mean 



S. D.. 



108.99 
105.11 r 
-102.25 - 
96.88 ^ 
^ 93.30 
90.69 
. 84.02 
82.23 
, 75.49 

71.29 . 
. 65,81 
60.82 
55.37 
50.22 
45.58 
' 42.08 " 
35.67 
20.28 
' 20.39 . 
■ ■ "r 



, 14.97 
14.13 
14.27 
13.45 
11.99 
1L07 
10.20 
9.95 ' 
O.Oi ' 

9.03 , 
8^0 

• 7.77 

•8il7 

8.04 " 
10.34 „ 

9.72 
9.60 
8.45 



Form B 



Mjcan 



^ 10.57 
106.60 

.102.70 
99.10 ' 
95.03; 
91.96 

• 86.23 
83.22 
76.11* 
71.52 
05.02 
60.75 
55.20 

< 49.62 
45.05 
42.02 
85.16 
29.C8 
20.23 



S. D. 



14.77 
13.98 ' 
13.09 ^ 
13.65 . 
13.33 • 
12.70. 
10.79 
10.90 
9.29 

'9.29' ^ 
> 8.69 . 
7.6r ^ 

7.00 

805 

7.74 

8.80 
,9.45 
' 8.80 
• 8.54 



j:er!c 
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;VALIDiTY: * ' 

.Content . Item sample drawn from all words in Webster's 
New Collegiate Dictionary which could be depicted by a 
picture* ^ Criteria for the Selection of the four words to 
be used in making up any one plate were:-? (1) all four words 
were found at the leveling arid pre-test stages to be of the 
same^ difficulty level T (2) -al^l four words demons-trated good 
linear growth curves in terms of per cent passing at succes- 
sive, a.ge level^s; (3) wbrds were used where no sex differences 
w^re found to exist; ^(4) primarily, siftgul^ar and collective 
nourts, some gerunds, and a few adjectives^ and adverbs, were , 
used; (5) words were omitted which' seemed to be biased cul- 
turally, regionally, and racially, as were dated word:s, , 
plurals, double words', scientific terms, etc. ^ . 

• The illustrations were drawn by an illustrator using 
the follpwing criteria:. (1) 'eqtial size; (2) equal in'tensity; 
(/3) equal appeal; and (4) appropriateness to the age level 
of subjects most likely to view the plate in the test situa- 
tion; i.e.,, in ge,neral, ^earlier plates were of young children 
itfiddle numbered plates were of elementa.ry children, and later 
plates were of adolescents and adults. (Dunn, 1965) 

Construct. "Ttem" vali di ty es t ab 1 i sh ed by s el ec t i ng 



individual words where the per. cenlTof "subjects passing 
increased from one age group to the next. (Dunn, 1965) 

Anglo-Sa:^on (English-speaking) group of 4th, 5th,' 6t^ 
^rade children scored 5.1 IQ points higher than Chicano 
(Spanish-speakilig) groups in same .grades (Corwin, 1962). 

In' Grade 5,^ 18 poor readers had a mean^PPVT IQ. of ■ 
94, 18 average ^readers 'had a mean IQ .of 97, 18* good readers 
^ad a mean IQ of 110. r • 
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VALIDITY (continued: Other Types 





Type of it 
'Validity 


Sample 


Age or # 
Grade ' 


v-rx uer^JLon 


Coefficient 


Study 


\ 


L 

Congruent. 


92 students*^ 
with IQs, * 

57 


A^ge" 12=14 — 
Grades 7-9 


IQ'' (KB-F) 
TO fWISC-V) 
TOfWISC-P) 


r «0,82 
P 

rp«0.86 
rp=0.70 




Lavitt 


1963 


I 


Ik . 


140 children 


Grades K-6 


^IQ(SB) 
IQ(WISC-F) 
IQ (WISC-V) 


rp=0.92 

r =0.57 
P 

r •=0.67 
P 




LindstroitT 


1961 










IQ(WISC-P) 


r^=0.39 








/ 








(The mean PPVT IQ 
averaged 10 points 
above mean WISC IQ>) 


• 








150 students 


Grade 7 


Henmon-Nelson 
Test of 
Mental Ability 


Form A 

r =0.64 

p 


Form B 
.rp=0.61 


Tempero & 
Iv anof f 


1960* 


1 






> 


California 
Tes t of 
Mental 
Maturity 


r =0.57 
p 










Concurrent. 






CAT-Reading 
& Vocabulary 


r =0.56 
P 


rr =0.58 
P 














CAT-Reading 
domprehension 


r =0.60 
P 


rp»0.68 




- 




• 






CAT-Arithmetic 
Re as oning 


r =0.50 
P 


-rp=0.57 


• > 


• 




I 




CAT- Ar i t hme tic 
Fundamentals 


rp=0.,40 


rp=0.49 

* 


« 












CAT-Lai:iguage 
Mechanisms'" 

CAT-* Language 
Spelling * 


rp«0.44. 

r =0.41 
P 


, r =0.45 
P 

'r «0.45 

P 








' Predictive. 


270 

children 


PPVT- 

August 

before 

Grade ^. 

MAT, 

Primary 

following 

Spring 


MAT-word 
knov; ledge 

MAT-word 
discrimination 

MAT-reading 


rp«-.39 
rp«0..35 

r^.o.aV 


r 

\ 


Klaus 

& Starke . 


'1964 i 



TEST ABBREVIATI6nS . 
WB-F » Wechsler-Bellevue - Full s'cale* 

WISC-V « Wechsler Intelligence Scale for Children - Verbal scale 
^ WISC-P « Wechsler Intelligence Scale for Childi^en - Performance 

scale ."^ 
^ . ' \ SB « Stanford Dinet ^ ^ * , 

CAT « California Achievement Test 
, ' • , MAT « Metropolitan Achiev.ement Test 

♦Tests un^er congruent are those measuring the same it^m'. Tests listed 
under concurrent are those with "practical" criterion (achievement tests 
are supposed to -be "practical** nontest criterion), i ^ 

ERIC • • 
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HELIABILITY: 
Standardization Sample. 



Age ' 


Number 


— : ' 

Alternate Form Pearson's. 
Reliability Coefficients 


18 


227 


0.84 


17 


"305 


0.84 • 


16 


354 ' 


0.80 


15 


307 


0.83 - 


14 


•269 


0.81 


13 


287 


0.70' • 




DU . 


U. /o 


.11 


384 


0.81 


10 


319 


0.77 


9 


259 


0.74 ■ 


8 


100 


0.79 


7 


100 


0.74- 


6 


183 


0.67 


5 


133s 


0. 73 


4-6 


122 


0.72 , 


4-0 


.110 


0.77 


3-6 


119 


0. 81 


3-0 


92 


0.75' 


2-6 


92 


- • 0. 76 ' 



other Samples. 



Type of 
Reliability 


Sample 


> Grade 


Coeffir- 
cient; 


Author &*Date 


Alternate • 
forms (both 
given- same 
day) 


150 

students 
{ group 
adminis- 
tration) 


7th 
grade 




Tempero 1960 
lyanoff 


Alternate *i 
forms 






rp=0.91 


Stanford 19 71 

Research 

Institute 


Test- 
re test 






\ 

rp=0.81 


tt 


Internal 
Consistency 


* 




r =0.88 

P . 
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SOURCE: Lloyd Dunn 

/American Guidance Service, Inc. 
720 Washington Avenue, S, 
Minneapolis, Minnesota 5541 
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PRESCHOOL INVENTORY 



I 

BEHAVIOR MEASURED: Achievement 2,n areas regarded as 
necessary for success in schoo\. 



AGE-GRADE RANGE: Age 3-6 (but could be used with older 
chiD^dren as six-year-olcjs pass only 2/3 of the items on 
the average). ^ ' ^ 



ADMINISTRATiON: Individual, oral; 15 minutes, untimed. 



OPERATIONAL DESCRIPTION: Re'sponses to some of the 64 items a: 
verbal; others are nonverbal. Items measure "information'*, 
about the self (e.g*, name, age, parts of the body); 
number concepts ("more" vs. "less")^; knowledge of basic 
sensory attributes (color names); spatial movement with 
respect to commqn environmental objects and phenomena 
("whi-ch way does a feirris wheel go?"; a rudimentary 
understanding of social roles ("What does a dentist do?")';, 
and the ability to fbllow simpler-directions as well as 
relatively complex directions that presume an iHider standing 
of prepositions ("behind," "under," "in," fete.)," tEducatiqjjal 
Testing feervi,ce«, 1970, p. .141.) ^ * * * ^ 



FORMS: One. 



C^ORMS: ^ He^dstart Sample. 



. t Age' - *. 


Number 


Mean* 


SD 


3.0^- 3.11 


158 ■ 


• * 25. 6 


.9.&"'' 


4.0 ^ ^.S.,-.. 


,528 ' 1 


30.0 


10.1 


'4.6 - 4.11,; 


438 ' 


33.9 


10. 5 


.5 , - 5.5, 


' 259 


'38.4 


J.0,1 


5 ..6 - 6.6 




42.4 


11.0 



Headstart Xs» this ^ i^eat.^ using a .32 it.em version; no\data is 
avail ab lo\y e t. ' * . ^ . 



OCrt of 64 it^s** 



IsfORMS (continued) : 

North Carolina Kindergarten children: 



Scfcial c;Lass 


Number 


. Mean 


SD 


Lower class 


82 


38. 6 


10.9 


Middle class 


136 


46. 5 


9.1 


Upper class 


99 


51.5 


8. 5 



VALIDITY: 

Content , Kindergarten curricula and classroom obser- 
vation provided data on skills children implicitly assumed 
to possess, in order to function in kindiergart^n classroom. 
These skills f as well as areas of deficit in disadvantaged 
children, were the basis for item construction. 

Construct . In the standardization sample the following 
correlations with Stanford-Binet IQ were obtained: 





r 


3.0 - 


3. 


11 " 


0.39 


4.0 - 


4. 


5 


0. 59 


4.6 - 


4. 


11 


0.64 


5.0 - 


5. 


5 


0. 65 


5.6 - 


6. 


11 


0.63 



These ar^ low enough to indicate that the test measures 
something other than general intelligence. 

Among 1875 children between 3,9 and 4.8, Preschool 
Inventory scores correlated .59 with the Picture Completion' 
and .54 with Form Reproduction scores on the WPPSI (Shipman, 
1971). 



RELIABILITY: 

Internal Consistency . The Kuder-Richardson (20) subtest 
coefficient in the., total standardization sample is 0.91. 

The Preschool Inventory is not meant to be a homogeneous 
test, but average biserial correlations between each item and 
the total, score (0.4B-0.56) are higher than for most achieve- 
ment tests covering a broad field of knowledge (Preschpol 
Inventory Handbook, 19 70. 
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SOURCE: Educational Testing Service, l>rlnceton, New Jersey 

REFERENCES: * * ' < /^V 
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competencies and styles prior to school entry,' Educational 
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SIGEL OBJECT AND- MCTURE 
CATEGORIZATION TESTS • 

BEHAVIOR MEASURED: Concept formation. 

AGE-GRADE RANGE: Ages 4-6. 



ADMINISTRATION: Individual, oral. Untimed; 40-60 minutes. 

OPERATIONAL DESCRIPTION: The Object Categorization Test 
utilizes^ twelve object's — matches, blocks, top, pipe, cup, 
notebook, ball , cigarettes , crayons , bottle opener (photo- 
graph of objects appears in Si gel and McBa ne'^ 1967^ ' Si gel 
and* Olmstead/ undated). - - 

The^^test has three sections: ^ Identification, Active 
Soft, and Passive Sort. In the Identification p&rt, * the 
child is asked what each object is*. In the' Active Sort, " 
the tester picks out an object, and asks the child to ^ick 
out the ones that are the same^or like it. Then he; asks- 
"Why are the' objects the same?" This procedure 'is repeated 
with each object. . In the Passive sort, tHe^ tester picks 
out three items and asks the child how they are alike. . 

FORMS: Oae. 



NORMS: Because no overall scores' are dea^ived from this t^st 
norms are very complex. They ate.foi^d in Tables 7, 8, 8:1, 
9, 9:1, 10, 10: 3, 10:4 in Sigel and 6lmstead fundated) . 



VALIDITY: / ; - v , 

' Content * The task, utilized an ar]f^y containing twelve 
life-sized familiar objects classifiable into four classes, 
kitchen things smoking things, toys, and writing things. 
All items were known and. could be labeled or. defined in some 
way. . : \ ^ , / 

Construct . Lower-class black and, to a lesser degree, 
white children, had greater difficulty classifying pictures 
than objects; and they used different types of . category 
for each representational .mediiam. Middle-.class wh'lte and" 
black chil<|ren , showed "no differences in grotfoing three- and 
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twor dimensional stimuli (Sigel, Anderson, Shapiro, 19 66; 
Sigel and McBane, 1967; Sigel and Olms-ted, iindated) . 
A later- study (Headstart Evaluation and Research Center, 
197'0) di^J not find this discrepancy. 

Training programs, modeled after Sigel, Roeper, and 
Hooper (1966) were successful in influencing quality and 
quantity of styles of categorization in five-year-old 
kindergarten children. The effects remained one year 
later. Training did not, however, influence the discre- 
pancy in categorization performance with objects and 
pictures (Sigel and Olmsted, 1968). Headstart alone sig- 
nificantly improved scores on both tests' in both the 
Active apd Passive Conditions^ (Headstart Research and 
Evaluation Center,' 1970). 

The following pattern of intercor relations between 
parts of the two tests was obtained in' a sample o,f 160 
Headstart children; 







RPC AOC DOC 


APC 


.56 .73 . 61 


PPC 


.49 .61 


AOC 


.69 


APC = Active . Picture feategorization 
RPC = Passive Picture Categorization 
AOC = Active Object Categorization 
POC = Passive Object Categorization 



Congruent . 

In the same sample, the pattern of correlations with the 
Stanford Binet and Preschool Inventory was as follows; 





Stan for d- 
' Binet 


Preschool 
■ Inventory 


APC 


.22 ; 


. .40 


PPC 


.28 


. 34 


AOC 


. 35' 


.40 


POC 


. 30 . 


. 40 ■ 



RELI^ILITY; 

Intej:fnal Consistency . Measures of internal consistency 
are not given because Sigel and Olmsted, feel that "such a 
reliability would reflect more the behavior of the subject 
than the consistency of the test" (p. 27,, iindatedj . 
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RELIABILITY (continued): 

Test order does have an effectl Test order interacts 
with sex and social class of the child. • C 

Test-retest . Grouping responses in Object and Picture 
Categorization Testes. ifim. 





^Tiine Interval 


Number 


r 


Active sort 
Passive sort 


6 months 
8 months 


81 
51 


0.69 
0.44 



(Sigel and Olmsted, undated) 



SOURCE: Sigel ^d Olmsted, undated. 
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STANFORD BINET INTjfeLLIGEflCE SCALE 

^ ■ / 

BEHAVIOR MEASURED: Genera?/ intelligence. 

V 
/ 

AGE-GRADE RANGE: Age 2 to adult. 



ADMINISTRATION: Indivi-dual oral administratiph. The 

examination ot a yqun'^ child can usually be. completed in 
half ah hour to foirity'' minutes ; that of 'an older child fre- 
quently requires an hour and a half. There are no timed . 
items before the iO-year-old level. 
. OPERATIONAL DESCRIPTION: 

At every age level some items require ' 
verbal responses, others require non-verbal responses. There 
is a wide range' of item types. For instance, the 4-year old* 
items involve vocabulary, memory, and form discrimination.. 
The test begins at an age level wh^re the particular child 
^ is likely to succeed, with some effort. For an average cfhiid 
* this point would be one year belov/ chronological age. Basal 
and ceiling levels vary with performance. * 

FORMS: .In the 1937 version there were two-* forms — 

L and M. But the 11960 revision changed .to a single form, .LM. 

NORMS: In general the mean Mental Age equals Chronological 
Age, where each '.item passed contributes one month to Mental 
Age below year 6, two mbnths above, year 6. But "standard 
deviations are totally variable, it is therefore necessary 
to use the IQ tables presented by Terman and Merrill (1962) 
in order to make comparisons with their normative sample. 
This sample, the 1937 standardization group, consisted of 
3184 native-born white subjects, including approximately 100 
subjex:ts at each half-year interval from 1 1/2 to 5 1/2 years, 
200 at each age. from 6 to 14', and 100 at each age from 15 
to 18. Each age group was equally divided between males and 
females. and geographically distributed within, the U.S. by 
region and degree of urbanization. 

VALIDITY: ■ / ^* « \ 

Content . The primary criterion for selection of items 
was to secure an arrangement of subtests which would fulfill 
"the assumption, that general intelligence is a trait which 
develops with age,". (Terman and Merrill, 1962, page*?). Only 
items which "would probably correlate well with acceptable 
griteria of intelligence" {pag6 9) < could be included. 
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VALIDITY (continued) c 
Content (continued) 

This intuitive, culturally-relative notion, whatever it means 
is the only source of face validity for the test. 

Construct s All items show an increase in percent 
passing at ^successive age levels. Only items having the 
highest correlations with total scores were retained in the 
19 6Q revision, this contributing to the measurement of 
general intelligence rather than specific abilities 
(Terman and Merrill, 1962)^' 

The results of McNemar's (1942) factorial analyses of 
all the items support the view that a single common factor . 
would explain performance, but Jones' (1949) study reveals 
the operation of group factors. Hof staett er ' s (1954) factor 
analys.es of"..inter-age correlations in Bay ley's eighteen- 
month growth study revealed three factors which account for 
a child's achievement: " ' SensOry-motor Alertness' accounts 
for -the variance of mental age scores for the first two , . 
years. . Beftweeji 2 and 4 years a second factor, 'Persistence' 
is operative and after 4 years 'Manipulation of Symbols.'*' 
(Terman and Merrill, 1962, page 35). . , 

Kirk (1958) was one of ' the first investigators • 
to show that ability ^ level can be changed by radical 
changes in early environmpht. Many structured educational 
progi^ams have produced largef> temporary changes in 
Stanford-Binet IQ (e.g./ ^ereiter and Engelman, 1966; 

Blank, 1970; Caldwell ^ in press) . 

Stanford-Binet IQ's are lowered by an adverse reac- 
tion bp the failures built into the standard test etdminis- 
tration. According to tKis procedure, the tester begins 
at a point where the child must exert some effort to 
succeed.' He continues up to that' mental age level Where 
the child fkils all six tests.. Thus, the child experiences 
increasing failure as the test progresses^ Hutt (1947) 
raised poorly adjusted children's IQs 4.5 points by altering 
this aspect of the procedure., Well adjusted children's 
scores were not affected. • ' L 

Many group differences in Stanford-Binet IQ have been 
oj^served. The following table shows the correlation between 
parental occupation and child's IQ found in one study. 

Estimated Average IQ's for Di<£ferent 
Occupational Levels (Goodenough, Ty;Ler, 19 59) 



Professional ^ / ' ' 116 

.Semi-professional, Marjagerial •112 

Clerical, Skilled TradW^s, Retail 107 

Semi- skilled/ Minor Cl%ical 105 

Slightly Skilled ^, , * 98 

Rural Owner Farm^ers '\ ^ 95 

Day Laborers • n\ 96 



.VALIDITY (continued) ,r. ' . r\ . . 

Congruent , Almost all -intelligence tests developed • 
since the StanfordvEinet have use^i. it as a validity criterion* 
•For example, the full scale WISC correlated ^. 82 with the 
Stanford'-Binet dn one study (Cronbach, , 19 60) . ' The correla- 
tion- 'with the Peabody Picture Vocabulary Test is presented 
in the- description of that test. 

Predictive , The following correlations between IQ in 
grade 9 (one school) and achievement tests one year later 
constitute a representative sample of Stan ford- Binet validity 
coefficients, 

' Reading comprehension .73 

Reading speed ^ .43 

English usage .59 

History ^ .59 

Biology . 54 

Geometry .48 (Bond, 1940) * 

RELIABILITY:/ * ' 

Internag consistency . The mean biserial correlation 
for all the< subtests (items) is .66. 



Test'7;lretest . The following table summarizes reliability 
studies with long intervals between administrations of the 
test. T|(ey assess IQ stability as much as test reliability.. 



— r^- — 

^ 


S-B 
Revision 


Ages , 


Pearson 

Correlation 

Coefficient 


Study 


111 Subjects from 

Standardization 

saijDple 


1937 


5 & 30 


.64 . . 


Bradway, 
1962 


10/6 adopted' 
cHi Idren 


1916 


4 & 13 


. 58 


Skodak, Skeels, 
1949 


50 subjects from 
Pels study ^ 


19 37 


6 & 13 


.67, .\ ■ 

4 J 


Sontag, B^ker, 
:^elson, 1958 



SOURCE: Houghton Mifflin x:6mpany, 2 Park Street, Boston, 
Massachusetts 02107 
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STEPHENS- DEL YS REINFORCEMENT CONTINGENCY INTERVIEW 



BEHAVIOR MEASURED: Locus of control (external vs. internal 
control of events). 



AGE- GRADE RANGE: Grades 3-8. 



ADMINISTRATION: Individual structured interview, Untimed; 
mean - 15-20" minutes.; r^nge - 10-30+ minutes* 



OPERATIONAL DESCRIPTION: 40 open-ended questions , e^g,, 
"Wha^'t makes mothers happy?", "What makes teachers angry?" 
Answers are scored internal if they describe reinforcement 
as contingent either japon the subject's own behavior or 
upon social rules. I 



FORMS: One. 



Sample 


— Age or Grade 


Mean Internal* 
Control Scores 
(SD not given) 


14 black; Heads tart girls 


Pre- 


8.7 


15 black Headstart boys^ 


. kindergarten 


8.1 


6- white Headstart ^irls 




13.0 


4 white Headstart boys 




'8.5 


17* white middle-class girls 




14:9 


li white middle-class boys 




11.5 


6 white middle-class girls, 




15;8 


9i white middle-class boys . 




14.4 



(Parker and Stephens, 1971) 



VALIDITY: 

, Content . Eight questions 'are asked about each of five 
reinforcement agents^ — self, peers, mothers, fathers, teachers 
(Delys and Stephens ,-,1971) . 



*Out of 40. 
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VALIDITY (continued): ' , ' 

Construct , * ' 

Chinese-American school children showed higher Internal . 
Control scores than comparable middle-class Anglo-American 
,4- ajid 5-year olds. American Indian children from a 
Headstart program scoi^ed about the same in Internal Control 
-as middle-class white nursery school children. Internal 
Control Scores consistently related to economic status within 
ethnic groups. Lower-class black and Appalachian white 
preschool children ' show the most extreme External Control 
V expectancies of all groups tested (Stephens and Delys, 1971). 
Anglo- and Afro-American preschool girls have higher Internal 
Control scores than boys. . Puerto 

Rican'/ Mexican, American Indian, and Chinese-American boys 
have more internal scores (Wang and Stephens, 1971). Regular 
increase in Internal Control scores with age from 3-8. 
Spanish-TVmerioan^ children had significantly higher Internal 
Control scores when interviewed by a Puerto Rican interviewer, 
either in. Spanish or English, rather than by an Anglo inter- 
viewer. This interviewer ethnicity effect did not show up 
with bl^ck children and a black interviewer (Stephens, 1971) 

Congruent . Low but f^rly consistent correlation 
between In.tejrnal Control score and Stanford-Bine t. Preschool 
Inventory, and Peabody picture Vocabulary Test score (Stephens 

1971). . ' \ 

Predictive . Relatively Internal scores associated with 
increasing school performance ovet time. Relatively External 
scores associated with decreasing school performance' over 
time (Stephens, 1971). , 

^r. « ' . 

RELIABILITY; 

Rater reliability. ,3^0.98 (Delys and Stephens, 1971). 

Internal consistency (split-half) and test-retest 
reliability^ . Two black Headstart ^ classrooms ; r= 0.65 (Delys 
and Stephen's, 1971). 

SOURCE: Dr. Mark Stephens, Purdue University, Lafayette, 
Indiana. , , 
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.. APPENDIX C 
. ' ' ' Simulation 





APPEN'DIJC C=^ESCRIPTXON OF THE SIMULATION PROGRAM 



Description of the simulation study 6f the proposed 
non-experimental design is most conveniently carried out 
in terms of (1) the generation of test statistics in the 
cross-sectional (Phases I and II) and longitudinal 
(Phase III) elements and (2) optimizati^Qn of the thr^e 
phase desigh with respect to critical Values of the test** 
statistics. Description of these components is provided 
in C.l and C.2 respectively; C.S provides the basic program 
listings, '\ 



C.l Generation of Test Statistics 



The relative complexity of the simulation is 
reflected in the somewhat cumbersome notation which 
follows : 

th 

^iikt " Test score of t subject with 
program residence category i, 
V program income category j , 

^ / neighborhood income category k. 



The additional (unknown) conditions which attach to the 
existence of "effects," self-selection of the first kind, 
(entering) , and self-selection of the second kind (exiting) 
are denoted as follows: 



#^ 0 (1 effects 

^0 no effects 



^ _ rl self-selection I 

0 no self-selection I 



^ _ rl self-selection II 

0 no self-selection 3^1 



198 

206 



The existence of effects and^ rerf-se^recrion df~the fif^t 
kind are both characterized by adding increments of ' 0.25(r 
to tlie subject's score; a denotes the population standard 
deviation of the measure. In the case of effects this is 
only added to the scores of residents ,(i=l); in the case 
of self -selection of the first kind it is added to the 
scores of non-residents (i=o) • Iff f ects, and self-selection, 
are both introduced through the mediating effect of the 
program variables. Thus when effects exist, for example, 
they only af fect the scores of sxibjects resident 'in 
high/moderate income ne ighbprhoods and/or moderate income 
programs . 

The introduction of effects and self-selection is 
carried out by changing the mean of the population from 
which .the scores are generated. ..This population is 
assumed to be normal v/ith mean 100 and standard deviation 
20.-'- The basic relationship for generating, simulated 
scores in the cross-sectional phases is therefore as 
follows: 



^ijkt 0-25^ (j+k), Ii(il+m)+(l-i)m] + 



Test scores generated toy means. of this equation are then 
used to compute the F statistics for tests of effects 
and self -selection . of . the first kind. This is. done for* 
all 4 combinations of the binary variables i and m^, and 
for three different levels of replication (6,9,12). 
The only difference between first and second phases is 
that the analysis in Phase I is carried our only for the 
j, k combinrations (i,l) and (0.0); in the second phase all 
four combinations are used. 500 complete sets of test 
statistics v;ere generated (including the longitudinal 
elements)' and stored on? tape. 



i . [ 

^Normal random numbers are generated through transform 
mation of uniform random numbers (CDC RNZ) by an argument 
of the central limit theorem. " ^ 



u = ( E x.-k/2) / yk/12 0 ^ X. - 1 

i=l . • v.; 

R.W. fanning, Njimerioal Ilethods for Sciejitists and Engineers 
McGraw-Hitl, New York, 1962. 
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The long ituddnal- phase- -d if f er s Tf rom t^e circs s - - \ 

sectional phase in two respects. In the f4^st place ^ 
the dependent- variable is now the differencb between 
the subjects original score and, his score during the 
second wave. In the second p^ace, self -selection of 
the -second kind, (correlation between mobility and 
achievement > is introduced. The methods of^ introducing , 
these features are now described. 

Self-selection of the second kind is introduced by 
simulating mobility amongst the subject population. 
A base mobility rate of 40% is assumed for all the 
programs over the two year period separating survey waves. 
The individual family's probability of moving is modified 
however, v/hen self-selection of the second^ kind is present 
Modification of carried out in a way designed to 'confound 
program classifications with the dependent variables. 
Thus subjects v;ith high scores in the baseline survey 
will have a greater probability of staying in high income 
programs than In Ibw income programs. Convereily/ those 
with low sCibres at the baseline will have a hiigher proba- 
bility of moving out of high income programs. }. • 

The expression relatirigi the probability tl^at a 
familty moves to its baseline score "and the chliracteris- 
tics, of the program is given by: 

Pr{inove/j, k, n, ^^jj^^) 

= - pn(j+k) Jpo(l-Po) '(^^^j^^^^^) 

When n=0 (no self-selection) the probability of moving 
is simply- p^. When n=l, the probability of moving ' 
is additionally dependent on the program classification 
(j/k),. on the baseline score relative to the mean for- 
that group of subjects and on the correlation coeff.icient 
(p) betv/een the binary random variable (move/not move) 
and the individual's score. This correlation coefficient 
was made to be 0.2 in the simulation. Using this method 
each subject was^ assigned a uniform random number and was 
deleted from the sample if this number was below the 
subject's calculated probability of i^^ovlng. Variance 
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"ratios were then computed' tq^t^st.fbr^ tiie^ig^^ 
association between moving vsl not moving and baseline 
scores. These require, or cpurse, the more compJLIcated 
expressions appropriate for analysis of variance""^ in 

.^-factorial design with unequal cell frequencies. 

It then becomes necessary, to arrive at gain scores 
for the remaining subject populatign. <^ In order to insure 
correlation between gains and probability of moving, 
gains are made to depend- on past scores as well as on 
independent variables. 'Differentiating the second wave 
score by a prime, the rislationship employed was: 



is a normal random variable .with zrero mean and variance 
otM,3 and r is. equal to 0.1. Thes numbers were ^ 
chosen to insure .(1) constancy of population variance, ' 
and (2) test-retest correlation of 6.75., This relationship 
was used to generate gain scores for 500 simulation runs 
of the longitudinal design. Test statistics for the 
existence of, both effects and self-sel.ection w^re generated 
and stpred on tape. 



The listing of the program used to generate al^L- 
simulated scores and the associated test statistics .is 
presented in. .Section* C. 3.1. 



201' 



CiZ-u O ptimization Methods 



The basic simulation experiment described in the 
last section provides statistics for tests for the 
existence of effects and of self-selection^ bias' through 
each phase of the investigation. By running the 
experiment 500 times at each level of replication, it 
is possible to arrive at good approximations of the 
multivariate distribution of these test statistics 
for. each of the eight combinations of effects and self- 
selection of both kinds,. These simulated test statistics 
can then be used to estimate the probability of failing 
each of these tests given a specified level of the 
critical value of . the test. By varying these critical 
values, the associated probabilities of failing (and 
passing) these tests will vary. As described in Section 
3 •6.2.1, solution of the design for optimal values of . 
these critical levels was carried out; the basic results 
were presented in Tables 14 and 15. The structure 
and methods of obtaining these results are described 
here . ' 

The objective function in this optimization program 

>is: 

(B-C) Pr {Finding an effect and Effect exists} 

C Pr{Finding and effect and No effect exis 
-K. 

B and C are real numbe,rs designed to measure the 
benefits, and costs associated with the alternative 
outcomes; K is the expected cost of the experiment 
itself, and is computed as the cost of successive phases 
times the probability of carrying them out. 

jf 

The complex elements of the problem are the evalua- - 
tion fo the probabilities. These expressions can be 
written as: ■ - 

11.' 
•Pr{EA)l} =• S Z Pr{E/l, m, n} Pr {A, m, n} 
m=0 . n=0 



i = 0,1 



2i0 
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The first terms in the simulation on the right are 
estimated by the relative frequency with which all 
the tests are passed in the 500 experimental runs for 
given values of the test statisitcs. The second term 
is the prior probability associated with the particular 
comb.ination of effects and self-selection. The eight 
combinations were each expected to be equally likely 
for the purposes of optimization* 

The actual optimization was carried out using a 
search method ^ since the approxiamtion to the objective 
is a grid method and convergence was obtained within a , 
maximum of 150 iterations. 1 



i„ ,.3 



Hooke, R. and Jeeves, T.A. "Direct Search" Solution 
of Numerical and Statistical Problems. Journal of the 
ACM, Vol. 8; No. 2 (April, 1961), pp. 212-22$. 
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1. Simulation Program 
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